it's an angle i'd take, it would make a refreshing change from them destroying everything they've touched like they have previously.
have them battle with madness for a bit because they quite clearly aren't up to the task of suburban living anymore. let them take over a town that's full of ghosts and only ricks son and the other girl who was a newcomer (also possibly a ghost, the way she dissapeared at the beginning) can see they're not ghosts and season 5 is all about them getting over madness and having to enter back into the wild with the walkers as that's now the only world they can live in.