So when it doesn't hallucinate, is that good enough to say that sometimes it understands and sometimes it doesn't? Or do you need there to be no possibility of it ever being wrong?
When it hallucinates about things that no human being would ever hallucinate, you can’t trust it even when it isn’t, and you can never know if it isn’t unless you check against another source. At that point, you have no reason to use it whatsoever.
There are many situations where output is self verifying, such as the solution to math or programming questions.
If it had 100% accuracy, that would be god-like super intelligence and it would have already replaced almost every non-physical job on the planet. We're definitely not there. But we're also not at 0%.
What hallucination problems have you experienced with it?
What is your criteria for true "understanding"?
Not hallucinating things that take five seconds for a human to prove.
So when it doesn't hallucinate, is that good enough to say that sometimes it understands and sometimes it doesn't? Or do you need there to be no possibility of it ever being wrong?
When it hallucinates about things that no human being would ever hallucinate, you can’t trust it even when it isn’t, and you can never know if it isn’t unless you check against another source. At that point, you have no reason to use it whatsoever.
There are many situations where output is self verifying, such as the solution to math or programming questions.
If it had 100% accuracy, that would be god-like super intelligence and it would have already replaced almost every non-physical job on the planet. We're definitely not there. But we're also not at 0%.
What hallucination problems have you experienced with it?