"Moving gives them an opportunity for a fresh start and a new chapter; an opportunity to leave some of the more unhappy memories behind," a source told the Sun of the move.

But soon after the family moved to their new home, things changed again. Queen Elizabeth died, just as Kate Middleton and Prince William landed in the dwelling. “It was not exactly the settling-in period they had hoped for,” a source said of that period in the Waleses’ lives.

Kate Middleton and Prince William will be moving house ‘later this year,’ a spokesperson at Kensington Palace confirmed to PEOPLE. The couple and their children — Prince George, Princess Charlotte and Prince Louis — will be settling into an 8-bedroom property in Windsor,