I enjoy archiving stuff from Twitter and am in a bit of a problem. My favorite way was through Nitter. It shows all the posts if it's an type post and comments from others. The only time I don't like it is when videos are involved.
Nitter is gone, and I can't seem to find an alternative. Straight from Twitter usually does a single post. Thread reader is great, but doesn't include comments.
Does anyone know a solution?
Elon wants X to be a walled garden where access will only be available through an account. He's been doing his very best to prevent outside sites from accessing posts. The likes of Poast and Privacydev's last remaining Nitter instances are being done through real accounts but there is always the danger of another clampdown on accounts scraping data for outside sites. It's described as a legal grey area and could attract the lawyers at X of whom Elon can pay for the best. There is also the prospect that if these accounts are not regularly posting on X or appear to be bots to X, they'll all be closed in time. The remaining instances do seem keen on preferring people host their own private instances and run their own accounts on X to get data for them, but that requires knowledge of compiling source code.
They work for now but don't rely on them just in case they get taken down or go private.
It makes sense- being able to scrape Twitter/X for posts would be a huge repository to train LLMs. Elon is a smart guy, and he wants a cut if someone is going to use “his property” to make money. The unfortunate downside is that archives will no longer work. I wish there was a way to communicate the need for archival of tweets to him, as I think he would be receptive.
The entire Internet is going to go this way soon. With LLMs, original data=power.
And yeah, ideally X would have its own archival service, possibly with screenshot hosting so embeds could point to either the static screenshot or the live tweet.
Yup. Twitter is fb but X'd, now. Just expect slightly less pedophilia, from elonic lizardry.