543 karma · joined December 20, 2020
I havent had any issues with bandwidth but it depends on how much you push through it. Ive seen stories throughout the years of people pushing 30-50TB before getting a temp ban from using cloudflare services. Of course DNS still works but you just cant use their proxy/cdn/tunnels/etc
Until this site succumbs to the challenges of being a free image host?
FWIW ArchiveTeam is grabbing as much as possible so it could eventually show up in the wayback machine. Though what they have now, 47TB, is a drop to the petabytes imgur probably has now. There was an estimated 376 TiB in 2015.
A trick I always use is to just append the url to archive.today[0] to get a page with no ads and bloat. You could also make a bookmarklet to make it a 1-click thing. Sometimes it might not be archived so you will have to click 'archive this url' to make one, but people are usually quick to archive articles that are posted here
[0]: https://archive.today/https://www.wivb.com/news/colorado-bec...
which leads to: https://drive.google.com/file/d/16ATMkf7SAwwjePZZZb0mFrFX5rM...
You get your own personal domain/subdomain of zlibrary after logging in
[0]: https://cdm-project.com/CDM-Tools/
[Link 2] 1 Dev makes entire team antisemetic? A developer has different opinions than us, how dare he. The only reason WB did anything is because how dangerous the hate-mob can be with threats an PR. Good on WB for not caring about devs opinions when hiring and only how good they can code (AKA their jobs):
> "I'm happy to say that, even though I disclosed my YouTube channel to WB Games, it didn't appear to be an issue for them. Not that they endorse anything that I've said, of course, but at least they seem more concerned with making good games than with pushing some kind of a social justice agenda, so there is hope."
[Link 3] This is reaching so hard. Terminally online people trying to make up an insane meaning for a meaningless item in a video game.
Even if they did it's clear that whoever made the screenshot in the libsoftiktok screen doesn't even have access to see their email. Like all other tech admin panels, there are access controls. Just because the 'delete website' button is visible to you doesn't mean your account has permission to use it.
Seriously love Hetzner, amazing prices and really fast human support.
Same goes for NSFW stuff, that stuff has been on Twitter long before Musk bought it and it will still be available just marked as sensitive (like it always has). I doubt they will go the Tumblr route and kill a giant part of the userbase.
But let's ignore that and repeat all the bad stuff the news told us Trump did, and how Biden is a saint for swooping in and saving our democracy.
[1] https://gist.github.com/antiops/00a37a1de289415fa7cbd9b5d1d2...
[2] ArchiveBox, can have full text search: https://github.com/ArchiveBox/ArchiveBox
ArchiveBox[1]: Pretty much a self-hosted wayback machine. It can save websites as plain html, screenshot, text, and some other formats. I have my bookmarks archived in it and have a bookmarklet to easily add new websites to it. If you use the docker-compose you can enable a full-text search backend for an easy search setup.
WebRecorder[2]: A browser extension that creates WACZ archives directly in the browser capturing exactly what content you load. I use it on sites with annoying dynamic content that sites like wayback and ArchiveBox wouldn't be able to copy.
ReplayWeb[3]: An interface to browse archive types like WARC, WACZ, and HAR. The interface is just like browsing through your browser. It can be self-hosted as well for the full offline experience.
browsertrix-crawler[4]: A CLI tool to scrape websites and output to WACZ. Its super easy to run with Docker and I use it to scrape entire blogs and docs for offline use. It uses Chrome to load webpages and has some extra features like custom browser profiles, interactive login, and autoscroll/autoplay. I use the `--generateWACZ` parameter so I can use ReplayWeb to easily browse through the final output.
For bookmark and misc webpage archiving then ArchiveBox should be more than enough. Check out this repo for an amazing list of tools and resources https://github.com/iipc/awesome-web-archiving
[1] https://github.com/ArchiveBox/ArchiveBox [2] https://webrecorder.net [3] https://replayweb.page [4] https://github.com/webrecorder/browsertrix-crawler
On some apps they also give a percentage back to the developer so you'd be supporting them.