I was shocked that anyone could be fooled by an LLM writing the most pathetic loverboy pseudo-poetry I've ever seen, let alone fall in love with it, before someone in the comments pointed out that the whole body of Wattpad was absorbed into the training data along with YA and romance novels. Probably 80% of that site is written porn. Worse yet, it clearly captures a large audience of tasteless adult women.
Someone else also pointed out that tech people also occasionally get fooled by LLMs, like that fedora-wearing Google engineer that detonated his career trying to protect a "sentient" AI build, and this is because the LLM is burping out a pastiche of their favorite Harlan Ellison stories about AI back to them. I assume this is where the futurist notion of sentient LLMs comes from. There are many things one could say about this, but I think it illustrates the inherent value of a real artistic establishment quite well.
This is like the mirror test for sentience, where an animal's self awareness is guaged on whether they can identify the reflection is in fact themselves.
It took me a while to get over it when I was playing around with character.ai which was really advanced for when it initially came out. After a while though you can see how all the responses follow the same kind of patterns, and they will just tell you what you want to hear.
I was shocked that anyone could be fooled by an LLM writing the most pathetic loverboy pseudo-poetry I've ever seen, let alone fall in love with it, before someone in the comments pointed out that the whole body of Wattpad was absorbed into the training data along with YA and romance novels. Probably 80% of that site is written porn. Worse yet, it clearly captures a large audience of tasteless adult women.
Someone else also pointed out that tech people also occasionally get fooled by LLMs, like that fedora-wearing Google engineer that detonated his career trying to protect a "sentient" AI build, and this is because the LLM is burping out a pastiche of their favorite Harlan Ellison stories about AI back to them. I assume this is where the futurist notion of sentient LLMs comes from. There are many things one could say about this, but I think it illustrates the inherent value of a real artistic establishment quite well.
This is like the mirror test for sentience, where an animal's self awareness is guaged on whether they can identify the reflection is in fact themselves.
It took me a while to get over it when I was playing around with character.ai which was really advanced for when it initially came out. After a while though you can see how all the responses follow the same kind of patterns, and they will just tell you what you want to hear.
What the hell is a Wattpad?
You do realize that guy was part of the PsyOp, right?
He was?