The Vaux family owned the Hall until 1695 when they sold it to Thomas Watson Wentworth, a son of Lord Rockingham of Rockingham Castle.

Two centuries later, the 7th Lord Vaux was able to buy back the Hall. He left the estate virtually untouched apart from a chapel he had built in the grounds. Lord Vaux died in 1935 and his daughter became Baroness Vaux of Harrowden. She was married to William Gordon Gilbey, the owner of a wine and spirits group.

On her death in 1958 the ownership passed to her eldest son, Father Gabriel Gilbey, a Benedictine monk. In 1962 he took his seat in the House of Lords as the 9th Lord Vaux, the first Benedictine monk to do so since 1559.