I saw a comment by a guy who said he believes AI specifically gives wrong answers to "people it doesn't like" and right answers to people it likes.
At first, I considered the theory funny but not likely, although...
Anyway, time went on and now I'm starting to wonder...
The first thing that clued me in was I asked AI to produce an image for me a few times and it wouldn't do it, saying what I wanted was not allowed given its programming. Some other people asked the same AI the same thing and got a picture generated.
Okay, maybe just a one-off mistake...
Just now though, I asked 4 different AIs to solve a Sudoku puzzle for me. Every single AI failed. I even corrected its mistakes and asked again. Sometimes, the AI would takes minutes before it came back with a wrong answer. A friend of mine, using the exact same photo, asked her AI to solve the Sudoku puzzle and within 10 seconds it had the right answer.
This makes no sense.
And, it has made me wonder... Do we actually all have a Social Credit Score already and that score determines how well the AI treats us? That might be something that has been programmed in behind the scenes that we aren't aware of yet. Perhaps, that's why the AI founders know they're going to be hated because they know once the switch is switched on and cranked up, it's GG.
Why would you expect a LANGUAGE model to solve something that is NP-hard?
So the way language models solve this is that they view the photo and assign columns and rows to the numbers then it creates a program to solve for the missing numbers based on the rule parameters. It should then spit out the correct answer and it did within 10 seconds for her but not for me.
why are you sure that that's how it works? Because it told you?
And assuming it were, and it was writing that program, why would you trust its programming each time? It's an LLM.
It's been probably about a year, but I ran an experiment with solving sudokus exactly like this using one of the "thinking" modes of chatGPT.
It showed the steps. In the case I tried chatGPT first analyzed the image and created a matrix of the numbers, e.g:
Line 1: * * * 1 * 2 * * * Line 2: * 4 * * 5 * * * 7 Line 3: 9 * * * * * * * * etc
Then it generated Python code to solve a sudoku. (there have to be tens of thousands or more of Python sudoko solvers in the training data)
Then it ran the Python code using the matrix as input.
It worked perfectly.
One of the things about AIs is that they are indeterminate--try the same input multiple times and you can radically different results. You absolutely need a "thinking" model to solve a Sudoku.