suramya_tomar

After taking a break and stepping away for a bit, I realized that I was recreating an archiving system for websites and that there are existing solutions that do the same thing.

I found https://github.com/ArchiveBox/ArchiveBox/ which is a self hosted web archiving system. It covers most of my usecases (and I can extend it for additional functionality) so I am going to set this up and try it out.

Thanks all for the help.

I don't have to use curl, but in the past when I have setup something that opens browser instances it has usually been a bit unstable in the sense that it would crash intermittently.

I wanted something that I could kick-off as a daily cron job.

That's a good point. I use Linux where file names are Case Sensitive and the sync to Windows has problems when the files are copied over to an NTFS partition or to my Android phone. However, the rest of the files are updated even though some files have issues syncing.

There is no alert etc generated just a message in the interface that sync is not complete.

yeah, just because there is a potential loophole we should make absolutely no effort to solve the problem.

Reminded me of: https://iea.org.uk/wp-content/uploads/2021/12/mister-gotcha-...

In this case it is addressing a large chunk of the problems. Once that is done we can always revisit other ways folks are spamming the system.

yeah, it really sucks that we improved security, reduced the risk of Man in the Middle Attacks, reduced impersonation risks by moving to a more secure protocol.

Actually, you don't need to manage certificates when we access sites over https as that is done on the server side. You just need to ensure that you are using the latest version of the SSL libraries when compiling systems.

Even then, most certificate providers give you ways to update certificates quickly and easily. If you do it correctly then you would only need to update them once a year. (you can set this to a longer duration)

- Suramya

Works fine for me without a login.

The article specifically says that they "drilled down into the hill and collected core samples that allowed them to use radiocarbon dating techniques to learn the ages of the layers that make up the hill."

They didn't randomly pickup dirt from the base of the pyramid and date it as you seem to be implying, they used the standard method of taking core samples at various depths to find the dates of the various layers of the pyramid. Based on that they made the claim.

Syncthing works over mobile data as well. You need to enable the option to Run on mobile data in settings. In addition you will need to Enable Relaying and Global discovery on both ends (phone and server)

I have been using it to sync photos and other data from Phone -> Desktop for a few years now and it works fantastically.

The issue with CD/DVDs is that they degrade quickly over time. The CDs I burnt in early 2000s had tons of read errors when I tried restoring in 2022.

Personally, I think storing data on an external Harddrive is the most stable option. You can keep upgrading the setup as required and the bit rot is minimal.

I backup my data on multiple drives, along with redundant copies stored in multiple locations.

I have heard good things about Tapes as well but have no personal experience with them.

Like you I also dislike the Blocks editor, however the fix is easy. You can install the Classic Editor (https://wordpress.org/plugins/classic-editor/) plugin and get the old interface back.

You can switch between the two if you want, and can configure it to be the default.

Well, wget still works and allows you to mirror a website with a single command The following command mirrors a given website:

wget --mirror --convert-links --adjust-extension --page-requisites --no-parent https://site-to-download.com

So not sure what you mean by there are no tools available to mirror a website.

Ah... fair enough. For me the annoyance is minor enough that I wouldn't be installing an extension that gets access to all the sites that I browse, but I get that for others it might worth it.

From the outside, it seems like an easy problem to solve but with all the multiple domains and the way federation itself works there is no quick/easy fix that doesn't bring other assorted problems into play

Not sure if I am missing something, but this is something I can do without any extra extensions installed? Out of the 27 accounts I am currently following, 20 are accounts from other Mastodon instances...

I do have to search for the account on my local instance to start following them instead of being able to click follow right there, but that is a minor annoyance

At the moment I check them manually. I have all the blogs bookmarked under 1 folder and use the "Open All in Tabs" option in Firefox to open all of them together first thing in the morning.

Quality is a must. It doesn't matter how frequently/consistently you post if the posts are not of good quality. There are a few blogs I follow where the author don't post very frequently but when they do the posts are extremely high quality so I keep checking them frequently even when they don't update regularly.

The quote you are talking about about consistency being awarded is more geared towards appeasing the algorithms to get more followers/visibility etc

You can use Tweepy (Python Package) to query their API for the data. You will need a Twitter Developer Account but the setup is quite simple. You can use the instructions at: https://towardsdatascience.com/how-to-access-data-from-the-t... to set it up.

I wanted a client to export my followers, Following and Lists (Members) as the official export didn't have it. Used Tweepy to create a script in a couple of hours to pull this data. It should it fairly simple to modify it to pull the tweets as well if you are interested. Or I can take a look and add it when I get some free time.

https://github.com/suramyatomar/TwitterExtract

Baen Books (https://www.baen.com/) is a publisher that only releases DRM free ebooks. They primarily publish scifi / fantasy books that you can buy from their site directly.

You realize that it is fairly easy to create false ID's right? There are services that do that for you with minimal fuss.

> When everyone has 2FA, 2FA backup keys become kind of impractical in the same way it becomes impractical to remember all your passwords.

This statement makes absolutely no sense. If you can't remember your passwords (and even if you can) you should use a password manager. The same can also hold your recovery keys. I also have a printed copy of the recovery codes in a file as well.

They are displayed by default when you enable 2FA. If I remember correctly there is a note stating that we should print them out or save in a secure location. They are meant to be used in this exact scenario where you don't have access to the 2FA device registered.

When I was changing phones and wasn't sure that Google Authentication app would move to the new phone seamlessly I actually disabled 2FA on all my accounts before activating the new phone and then set it up again over there. Did I need to do this, probably not but it did ensure that I wouldn't loose access due to a missing 2FA app.

I use it on my laptop because it is stable and because I want my desktop and laptop to have the same environment as much as possible. Lots of others do the same as well. More and more people are moving from desktops to laptops so supporting them is an important consideration, This issue was important enough that it was addressed as part of the "How is Debian Doing" post earlier this year.

How is adding the firmware for the common chips to the installation media 'wasting their limited, mostly community funded resources' ? The packages are already there in the non-free branch they just need to add it to the installation packages. Plus a lot of testing and sanity checks but it is not like they need to recode the entire system which is what you seem to be making it out to be.

The firmware packages are stable and work great. All this is doing is including them in the initial setup itself rather than asking folks to download and install manually.

If your account gets compromised attackers can use the details from the history to move laterally in the network, because if you have passwords etc in the history then the attackers have access to it as well.

This is especially true for bridge / bastion systems that control access to internal servers. If the passwords/secrets to access the internal servers are in the history they get compromised as well.

https://coveryourtracks.eff.org/ from EFF does something similar using analysis of all the data shared by your browser. It also gives you a score of how unique your browser signature is as compared to other users

It's telling the truth without sugarcoating it in crypto make believe. That's why people read it.

If any of the stories / updates on the site are false please do share since from my reading I found all of them are accurate and to the point.

In one of my previous roles we had an ongoing argument about using Confluence vs Mediawiki as both were already deployed and we wanted to promote MW more due to the cost (plus it's opensource). The main reasons cited were as follows:

* Easy usability, Confluence was a lot more easy to use than MW * Great integration with other tools such as Jira (You could embed Jira tickets etc in the Wiki) * Looks nicer

It can be used as a launch pad into the rest of your network as IoT devices are notoriously insecure. There was a case a few years ago where a bank was hacked via the internet connected thermometer in the fish tank.

One option (which is what I do) is to create a separate WiFi network for your IoT devices that is isolated from the rest of your network. A lot of the modern routers have the option of a 'guest' wifi so you can enable that and use it for the IoT devices.

You should also check for and apply any security updates/firmware updates for the device and then regularly check for the same.

One option is to use IMAP and connect to your gmail account using a email client (I use Thunderbird) once you connect, sort the mailbox by size and then delete as required.

Another thing to remember is that file on your Google Drive and Photos are also using up space, make sure you clean up over there as well to free space.

There are a few options:

I will give the same advice I got when I told my manager that I wanted to keep coding while moving up the ladder. She told me that I should pick a project/problem where I wouldn't be a bottle-neck if I got sidetracked due to other commitments and code that. This way I would still get to code but not cause bottlenecks in the flow and it worked fine for the most part.

Another thing I have been doing is that I would code PoC's to validate a concept or solve an interesting problem and then hand it over to the junior folks to add the boring stuff (error checking/unit-tests etc) to make it production ready.

This approach allows me to solve interesting problems without having to do the 'boring stuff' . :)

Yeah, its hard to get users to download/run code, which is what I had planned to do initially. I have code that I wrote that runs on my local machine to test both ISP's that I use (I have a dual connection) and stores the result.

Then I realized that very few people will download/run code from the internet just to help test the connectivity/blocking status. So, I am trying to figure out a way to do this that makes it as easy as clicking a button by a visitor. But so far haven't had much luck getting it to work as of yet.

Yup, I was hitting issues due to CORS and was wondering if there is a way to avoid them.

I can ask folks to download and install something but if I am doing that then I can might as well ask them to download and run the Python code I have running on my system than install an extension. The idea was to make it as easy as possible to report.

The issue with hosting instances in regions around the globe is that the ISP's I am concerned about are more residential focused than commercial. Another interesting aspect is that the same ISP may be blocking a site in one city but not another so it makes it harder to get data just by running them in data centers around the world

Thanks. This is great and works pretty well. I use SyncThing to sync the files between the Phone and my Desktop so all my changes get sync'd bidirectionally automatically.