I enjoy archiving stuff from Twitter and am in a bit of a problem. My favorite way was through Nitter. It shows all the posts if it's an type post and comments from others. The only time I don't like it is when videos are involved.
Nitter is gone, and I can't seem to find an alternative. Straight from Twitter usually does a single post. Thread reader is great, but doesn't include comments.
Does anyone know a solution?
It makes sense- being able to scrape Twitter/X for posts would be a huge repository to train LLMs. Elon is a smart guy, and he wants a cut if someone is going to use “his property” to make money. The unfortunate downside is that archives will no longer work. I wish there was a way to communicate the need for archival of tweets to him, as I think he would be receptive.
Correct, the reason Twitter has done this is the same reason Reddit locked down their API (and broke 3rd party Reddit apps). The introduction of ChatGPT made the data incredibly valuable. This means that they can sell it, but also means that if they didn't lock it down they'd have huge amounts of bots scraping everything and costing very large sums of money.
The entire Internet is going to go this way soon. With LLMs, original data=power.
And yeah, ideally X would have its own archival service, possibly with screenshot hosting so embeds could point to either the static screenshot or the live tweet.