The Arwell family comes to his house to find the Doctor acting as the caretaker in 2011 Christmas special "The Doctor, the Widow and the Wardrobe".
Source: The Doctor Who Locations Guide