I think the big pitfall on the horizon that no one's paying attention to yet is the feedback loop that will effectively destroy record keeping.
Right now you have the baseline internet full of information provided by people. Now you add some AI that parses it all and people use the AI to look stuff up(ChatGPT, etc). People read the hallucinations that said AI produces, are too dumb to know any better and believe it and then proceed to write down those hallucinations as fact for the next round of AI to scrape off the internet. Repeat ad nauseam and now no one can tell what's real vs what's an AI generated hallucination.
This is only going to be made worse by the fact that search engines have been shitting the bed so hard for the last several years.
I think the big pitfall on the horizon that no one's paying attention to yet is the feedback loop that will effectively destroy record keeping.
Right now you have the baseline internet full of information provided by people. Now you add some AI that parses it all and people use the AI to look stuff up(ChatGPT, etc). People read the hallucinations that said AI produces, are too dumb to know any better and believe it and then proceed to write down those hallucinations as fact for the next round of AI to scrape off the internet. Repeat ad nauseam and now no one can tell what's real vs what's an AI generated hallucination.
This is only going to be made worse by the fact that search engines have been shitting the bed so hard for the last several years.