Like, it literally creates answers out of thin air then sells it as if it's correct. It doesn't even try to get it right. What sort of redundancy is there in analyzing if the answer is correct before spewing it out? I thought LLMs were supposed to discern what the best answer is given what was said to it based on its training, yet it'll give answers that don't exist based on any training. It's not like it learned the wrong answer from a Reddit post and just posted what Reddit said. It legit is making up wrong answers then citing correct answers. It just outright gets it wrong almost on purpose.
Anyone understand why LLMs fail so much?
I understand they run correlations but how does it determine a wrong answer is the most correlated to the correct response given the prompt instead of the actual correct answer...
A blogger, who runs servers for a living, hates Ai and collects old computer stuff (I think he still has every device he's owned since the 90's? Or most of them at least) gives Ai a try now and then.
He found an old graphics card & wondered why that company didn't do well, it had good specs for the time. So he asked Ai. It gave him an interesting, detailed report on the company, graphics cards from that era & so forth. Not one of the companies named was real, none of the cards mentioned were real, it was 100% made up :/
He hates Ai even more now, if that were possible.
The only time I use LLMs is for web searching, because online websearch has become utter dogshit, and it lets me compile a reasonable list to go through.
They've spent billions of dollars and thousands upon thousands of hours of manpower to give me google search from ten fucking years ago.
The real secret is always asking for references so I can go down the rabbit hole myself and double-check everything.
Yeah, that's happened to me. It'll gives me the answer to something that sounds plausible but when you fact check its response, it's all made up. Happens way too often.