If they didn't live there that is one thing, the impression given is that all three lived there, and for those calling people reactionary and pretending to be the arbitors of true justice and pretending they are better.
Get the hell over yourselves, its an opinion, media suggests 3 brothers live at address, people assume the three are guilty, boo hoo, media then tells people one one person lived there, people change their opinion, that is how information and opinion works.
However, personally I think their is some responsibility here, if I went over to say my brothers house, and there was a door I knew went to the basement and he freaked out if I went near it, and my brother was a nut job, frankly I'd keep an eye on him, if he was taking food into the house for 4 people.... I would get someone to follow up on it.
Ignoring obvious signs for a decade is criminally irresponsible, as is police, if true, ignoring reports of seeing these girls naked in the garden.
They may or may not be guilty of the actual crimes of rape/kidnapping, but they sure as hell never did anything about the suspicious behaviour of the man. Think about it, your brother, or any family member starts acting really weird, acting weird around a suspiously over a locked door, you just utterly ignore it for a decade? There is a fine line between not knowing and willful ignorance.... the latter is pretty unforgiveable in this situation.