We don't know who lived at #11 - I just picked that number as the most likely number that one could misread "4" for.

If Harry was packed off to Social Services, he could get so thoroughly lost in the system that there'd be no need for "blood protection", since nobody would know where he was.