This is what neural networks do: they aggregate data. Statistics would abstract out a model of general trends, while neural networks do the opposite: they render out a detailed picture, hallucinating specifics from its training data.

The problem here is that people are misusing the systems, assuming it can have credibility to answer random questions. It works better when you ask it to write code, but not so much with factual information when the training data is the internet.