The Dursleys

Harty figured while he hates the only Family he had growing up, while staying with the Dursleys would be for him, he wouldn't have any problems with his fans and being Famous in Private Drive.

Professor McGonagall told him she said to Headmaster Dumbledore that: " They're the worst sort of Muggles, imaginable."

And yes they are the worst human beings he had ever meet but the only family he has in the Muggle World, he will stay with them.