And the Amish start earlier, which means that even if they have the same amount of kids as another family they will also be stopping earlier.

We could probably sit here all day listing factors that probably contribute just as much as vaccines speculatively. Which is the point of "science and control groups." To remove as many of those as possible to try and only measure the singular variable.