Hacker News Reader

Comment by jchook | Hacker News Reader

Twitter only stores your last 3200 likes.

What a bummer. I like a lot of very funny or informative stuff on twitter and the tweets often pop into my head even years later. Sometimes I wanna find that tweet (eg to share) and I can’t.

I started using pinboard.in, which archives all my likes, but the search suuuucks.

So, I started building my own archive tool, but the search part is still hard.

I have looked into annoy, perkeep, tf-idf, Doc2Vec, and various other tools, but nothing really works as well as I had hoped.

Your project definitely gave me some ideas! Thanks.

View on HN

My https://github.com/dogsheep/twitter-to-sqlite tool has a solution for that: you can export your entire Twitter account as a zip, load more than 3,200 liked tweet IDs from that archive, then backfull their full inflate versions by fetching them from the API.

Documentation for doing that here: https://github.com/dogsheep/twitter-to-sqlite#importing-data...

Wow, I did not know that. This is such a no brainer paid feature for a premium Twitter plan: storage & search.

I suspect they probably keep all likes, but do not expose them.

Another premium service that searches your Twitter like is https://www.favourites.io/, but it's too costly for me. I might pay $10 for a yearly subscription, but not 29 GBP/year, which is ~10% of my monthly rent.

If they do keep all the data, you should be able to get it via GDPR

Yeah, you can access all the data of your own account, but third-party apps accessing your data via OAuth is another issue.

In the case of Twitter's API, third-party apps can access all of your history if you upgrade to a paid partnership plan.

You can access all your favorites (and tweets and DMs) by downloading your twitter archive.

You can use Twitter Archive Eraser to browse the whole archive, search by keywords, regular expressions, mentions, tweet type, media etc.

Twitter Archive Eraser allows you to bulk delete thousands of tweets at once also.

https://martani.github.io/Twitter-Archive-Eraser/

> I started using pinboard.in, which archives all my likes, but the search suuuucks.

What's also annoying is that I don't think there's a way to exclude from_twitter bookmarks in Pinboard when you search. So now that I enabled this feature a while ago everything is cluttered with tweets and Pinboard become useless for me.

Something like a -from_twitter search would be helpful but there's only a "+" search right now.

Reply on news.ycombinator.com