I noticed early on in the show that once they had a nice group set up, the threat from zombies was always either a surprise attack, or the "swarms" just being too large for the group to handle. There's only so much mileage you can get out of that cliche before people start questioning the worldbuilding.