But there still is a profit motive for the AI company to keep people in need of their AI therapist. Friends have much less of a profit motive to keep you unstable. They want you to be stable so you'll stop bothering them.
That's why I mentioned "General Purpose." Someone selling "AI therapists" will have a big incentive. But less so for ones without that focus. They won't care if you're happy, depressed, or curious about pandas as long as you're engaging.
But you're right about "AI therapists." They'll have the same incentives as normal therapists.
Well as the research shows, general purpose AI is commonly used for therapy and companionship. The AI companies know this and therefore have an incentive to keep their users lonely and unstable.
But there still is a profit motive for the AI company to keep people in need of their AI therapist. Friends have much less of a profit motive to keep you unstable. They want you to be stable so you'll stop bothering them.
That's why I mentioned "General Purpose." Someone selling "AI therapists" will have a big incentive. But less so for ones without that focus. They won't care if you're happy, depressed, or curious about pandas as long as you're engaging.
But you're right about "AI therapists." They'll have the same incentives as normal therapists.
Well as the research shows, general purpose AI is commonly used for therapy and companionship. The AI companies know this and therefore have an incentive to keep their users lonely and unstable.