I enjoy archiving stuff from Twitter and am in a bit of a problem. My favorite way was through Nitter. It shows all the posts if it's an type post and comments from others. The only time I don't like it is when videos are involved.
Nitter is gone, and I can't seem to find an alternative. Straight from Twitter usually does a single post. Thread reader is great, but doesn't include comments.
Does anyone know a solution?
Elon wants X to be a walled garden where access will only be available through an account. He's been doing his very best to prevent outside sites from accessing posts. The likes of Poast and Privacydev's last remaining Nitter instances are being done through real accounts but there is always the danger of another clampdown on accounts scraping data for outside sites. It's described as a legal grey area and could attract the lawyers at X of whom Elon can pay for the best. There is also the prospect that if these accounts are not regularly posting on X or appear to be bots to X, they'll all be closed in time. The remaining instances do seem keen on preferring people host their own private instances and run their own accounts on X to get data for them, but that requires knowledge of compiling source code.
They work for now but don't rely on them just in case they get taken down or go private.
It makes sense- being able to scrape Twitter/X for posts would be a huge repository to train LLMs. Elon is a smart guy, and he wants a cut if someone is going to use “his property” to make money. The unfortunate downside is that archives will no longer work. I wish there was a way to communicate the need for archival of tweets to him, as I think he would be receptive.
Correct, the reason Twitter has done this is the same reason Reddit locked down their API (and broke 3rd party Reddit apps). The introduction of ChatGPT made the data incredibly valuable. This means that they can sell it, but also means that if they didn't lock it down they'd have huge amounts of bots scraping everything and costing very large sums of money.
The entire Internet is going to go this way soon. With LLMs, original data=power.
And yeah, ideally X would have its own archival service, possibly with screenshot hosting so embeds could point to either the static screenshot or the live tweet.
Yup. Twitter is fb but X'd, now. Just expect slightly less pedophilia, from elonic lizardry.
nitter dot poast dot org still works, that is what Ive been using for a while. What has been iffy for me is archive, sometimes it loads, sometimes it doesn't
Well, that loaded. Thank you.
It won't archive, so I will see what I can do from there.
It's been extremely flaky for me when reading replies to threads. Hitting refresh multiple times is common, and some threads just plain don't load at all.
Better than nothing, though. And I refuse to make a twitter account on principle.
It will last another 30 days maximum. The APIs that were used to get access to twitter data no longer exist. When these final tokens expire, it goes kaput.
The API that's gone was to get guest accounts. The poast nitter doesn't use those, but that means it can't handle a lot of traffic.
Something is going on, because I can get account feeds to load, but when I click on a tweet to read comments, I get "tweet not found"
nitter.poast.org works for now
The long list will be done this week or next. I got busy for a while and couldn't do much. There's over 400 links.