HNHacker News
TopNewBestAskShowJobs

Sanzig

2,219 karma · joined June 20, 2019

submissionscomments
Sanzig··on Why Self-Host?
I'm currently using Restic + Backblaze, but I'm building a new NAS with OpenZFS. My plan for it is to use ZFS send to backup whole datasets automatically. I was thinking of giving zfsbackup-go [1] a try, since it allows using ZFS send with any S3 object storage provider. No idea how well it'll work, but I'll give it a shot.

[1] https://github.com/someone1/zfsbackup-go

Sanzig··on Fire destroys S. Korean government's cloud storage system, no backups available
That's incorrect. Current asymmetric (ie: public-key) algorithms built using prime factoring or elliptic curve techniques are vulnerable to quantum attack using Shor's algorithm.

However, symmetric algorithms are not nearly as vulnerable. There is one known quantum attack using Grover's algorithm, but with quadratic speedup all it does is reduce the effective length of the key by half, so a 128-bit key will be equivalent to a 64-bit key and a 256-bit key will be equivalent to a 128-bit key. 256-bit keys are thus safe forever, since going down to a 128-bit key you are still talking age-of-the-universe break times. Even 128-bit keys will be safe for a very long time. While being reduced to a 64-bit key does make attacks theoretically possible, it is still tremendously difficult to do on a quantum computer, much harder than the asymmetric case (on the order of centuries even with very fast cycle times).

Finally, it's also worth noting that asymmetric cryptosystems are rapidly being updated to hybrid cryptosystems which add post-quantum algorithms (ie: algorithms which quantum computers are believed to provide little or no speedup advantage). So, going forward, asymmetric crypto should also no longer be vulnerable to store-now-decrypt-later attacks, provided there's no fundamental flaw in the new post-quantum algorithms (they seem solid, but they are new, so give the cryptographers a few years to try to poke holes in them).

Sanzig··on Building the heap: racking 30 petabytes of hard drives for pretraining
I do appreciate the scrappiness of your solution. Used drives for a storage cluster is like /r/homelab on steroids. And since it's pretraining data, I suppose data integrity isn't critical.

Most venture-backed startups would have just paid the AWS or Cloudflare tax. I certainly hope your VCs appreciate how efficient you are being with their capital :)

Sanzig··on Building the heap: racking 30 petabytes of hard drives for pretraining
Did you do any kind of redundancy at least (eg: putting every 10 disks in RAID 5 or RAID Z1)? Or I suppose your training application doesn't mind if you shed a few terabytes of data every so often?
Sanzig··on Bcachefs removed from the mainline kernel
I doubt the OpenZFS team would move to GPLv2 if they were able to relicense to anything they wanted. Given their close association with FreeBSD, BSD-2 or a similar permissive license wouldn't shock me.

But it's an academic exercise anyway, since it seems Oracle has no intention of allowing them to relicense.

Sanzig··on Bcachefs removed from the mainline kernel
You are ascribing motives to the OpenZFS project that aren't there. Sun was the one that licensed it CDDL, and OpenZFS is a fork that was created when Oracle bought Sun and decided to close source ZFS. Oracle has zero involvement with OpenZFS.

Since the pre-fork code is from Sun, Oracle owns the copyright, and they won't re-license it.

The idea that the OpenZFS team wants CDDL out of spite for Linux is an absurd conspiracy theory. Their hands are tied - I'm sure they'd move to a compatible license if they could, but they can't.

Sanzig··on Bcachefs removed from the mainline kernel
Sun is dead and the ZFS copyright transferred to Oracle who then turned it into a closed source product.

The modern OpenZFS project is not part of Oracle, it's a community fork from the last open source version. OpenZFS is what people think of when they say ZFS, it's the version with support for Linux (contributed in large part by work done at Lawrence Livermore).

The OpenZFS project still has to continue using the CDDL license that Sun originally used. The opinion of the Linux team is the CDDL is not GPL compatible, which is what prevents it from being mainlined in Linux (it should be noted not everyone shares this view, but obviously nobody wants to test it in court).

It's very frustrating when people ascribe malice to the OpenZFS team for having an incompatible license. I am sure they would happily change it to something GPL compatible if they could, but their hands are tied: since it's a derivative work of Sun's ZFS, the only one with the power to do that is Oracle, and good luck getting them to agree to that when they're still selling closed source ZFS for enterprise.

Sanzig··on Qwen3-Omni: Native Omni AI model for text, image and video
When DeepSeek first hit the news, an American senator proposed adding it to ITAR so they could send people to prison for using it. Didn't pass, thankfully.
Sanzig··on Disney+ cancellation page crashes as customers rush to quit
The broadcast license is also strictly speaking only necessary for over the air stations, it does not apply to cable. Cable providers get ABC for cheap due to Section 111 compulsory licensing (short version: a cable provider can retransmit an OTA station for only a small royalty), but there's nothing stopping Disney from offering ABC to cable providers for a similar cost if their license is pulled.

So, the impact at the end of the day is just lost revenue from antenna users. Cable and satellite would be unaffected. That's got to be a relatively small number in the grand scheme of things.

Sanzig··on YouTube addresses lower view counts which seem to be caused by ad blockers
A deepfake version of Mark Carney keeps trying to get me to sign up for scam crypto exchanges. Clicking the report link does nothing.

With all the money that Google has plowed into AI, they clearly could solve this problem if they want to. The fact that it's still an issue means they don't care, or are happy to take the ad money from the fraudsters.

Sanzig··on YouTube addresses lower view counts which seem to be caused by ad blockers
Sponsorships are the primary way YouTube creators make money. There aren't many things that could knock YouTube off its near-monopoly market position, but banning sponsorships is definitely one. Creators would revolt.
Sanzig··on CubeSats are fascinating learning tools for space
Not really. Radiation shielding has diminishing returns with thickness as the relationship is logarithmic. A few millimeters of aluminum cuts down most of your ionizing dose by orders of magnitude over unshielded, but doing appreciably better requires impractically thick shields.

And that only helps with ionizing dose, which is already not really a problem in LEO. The issue is more high energy particles like cosmic rays, which cause single event effects (SEEs) - things like random bit flips in RAM or CPU registers, or transistor latchup that can cause destructive shorts to ground if not mitigated. These are impractical to shield against, unless you want to fly a few feet of lead. So instead we mitigate them (ECC memory, watchdog timers, latchup supervisor circuits that can quickly power cycle a system to clear a latchup before it can cause damage, etc).

If you want to get an idea of how much shielding is effective in a particular orbit, you can use ESA's SPENVIS software (online, free): https://www.spenvis.oma.be/. Despite being free, it's the tool of choice for initial radiation studies for many space missions worldwide.

Sanzig··on CubeSats are fascinating learning tools for space
Not really. There are a couple of open source projects (LibreCube being the biggest example) but they aren't flight-ready.
Sanzig··on CubeSats are fascinating learning tools for space
The annoying answer is "it depends." The main drivers are reliability (ie: how much risk of failure are you willing to accept) and mission life (ionizing dose is cumulative, so a 2 year vs. 10 year mission will have different requirements).

I would say you certainly need to start seriously considering at least some radiation hardening at around 600 km, but missions that can accept a large amount of risk to keep costs down still operate at that altitude with non-hardened parts. Likewise, missions with critical reliability requirements like the International Space Station use radiation hardening even down at 400 km.

The "hard" limit is probably around 1000 km, which is where the inner Van Allen Belt starts. At this altitude, hardware that isn't specifically radiation hardened will fail quickly.

The inner Van Allen Belt also has a bulge that goes down as low as 200 km (the South Atlantic Anomaly), so missions in low inclined orbits that spend a lot of time there or missions that need good reliability when flying through the SAA may also need radiation hardening at comparatively low altitudes.

Sanzig··on CubeSats are fascinating learning tools for space
Email sent. I am generally very busy with family commitments but happy to stay in touch.
Sanzig··on CubeSats are fascinating learning tools for space
Yep, but students love reinventing the wheel ;).

I agree though, my dream for years has been an open source CubeSat bus design that covers say 80% of academic CubeSat use cases and can be modified by the user for the other 20%. Unfortunately I have very little free time these days with family commitments.

Sanzig··on CubeSats are fascinating learning tools for space
In my experience, having provided advice to a lot of academic CubeSats: the issues usually aren't related to the parts, the problems are usually lack of testing and general inexperience.

Yes, a Raspberry Pi isn't radiation hardened, but in LEO (say around 400-500 km) the radiation environment isn't that severe. Total ionizing dose is not a problem. High energy particles causing single event effects are an issue, but these can be addressed with design mitigations: a window watchdog timer to reset the Pi, multiple copies of flight software on different flash ICs to switch between if one copy is corrupted, latchup detection circuits, etc. None of these mitigations require expensive space qualified hardware to reasonably address.

The usual issues I see in academic CubeSats are mostly programmatic. These things are usually built by students, and generally speaking a CubeSat project is just a bit too long (3-4 years design and build + 1-2 years operations) to have good continuity of personnel, you usually have nobody left at the end there since the beginning except the principal investigator and maybe a couple PhD students.

And since everyone is very green (for many students, this is their first serious multidisciplinary development effort) people are bound to make mistakes. Now, that's a good thing, the whole point is learning. The problem is that extensive testing is usually neglected on academic CubeSats, either because of time pressure to meet a launch date or the team simply doesn't know how to test effectively. So, they'll launch it, and it'll be DOA on orbit since nobody did a fully integrated test campaign.

Sanzig··on We all dodged a bullet
So basically, Boost for JavaScript?
Sanzig··on Signal Secure Backups
Assuming that the developer of Syncthing-Fork doesn't mind providing ID to Google, they shouldn't have an issue getting a signing key (we will see how this works in practice). They aren't doing anything objectionable to Google.

The bigger issue for third party apps will be things like Newpipe, where applying for a key will put the developers in danger of a lawsuit because it affects Google's business.

(The APK signing requirement is a fiasco, I'm not defending Google. Just pointing out that this app will probably not be as seriously impacted as others).

Sanzig··on Signal Secure Backups
IIRC, that used to be the opinion of the Signal project as well, but backups are such a requested feature it looks like they've finally decided to offer it.
Sanzig··on The math of shuffling cards almost brought down an online poker empire
Do you? Modern CPUs have had built-in TRNGs for years.
Sanzig··on The math of shuffling cards almost brought down an online poker empire
RDRAND has a throughput of hundreds of megabytes per second on most processors. Getting 226 bits is pretty easy, even shuffling millions of decks per second you'd be bottlenecked elsewhere.

(That does sound like a fun optimization challenge: "write a program to fairly shuffle the most decks of cards per second possible.")

Sanzig··on A Navajo weaving of an integrated circuit: the 555 timer
How is this cultural appropriation? The artist is Navajo.
Sanzig··on Pump the Brakes on Your Police Department's Use of Flock Safety
At least you could always leave the small village. Can't really do that anymore.
Sanzig··on House to investigate Wikipedia over allegations of organized bias
The Trump admin has a lot less leverage over Wikipedia, though.

The Wikimedia Foundation does not depend on US government funding and even if the US somehow made life difficult for donors, they are sitting on a substantial endowment fund that can float them for a long time.

And at some point, if the harassment gets to be too much, Wikimedia can just up and leave. There's no reason that the Wikimedia Foundation needs to be headquartered in San Francisco, it could just as easily be in Oslo or Paris. That's a huge advantage that Harvard didn't have.

Sanzig··on Robots.txt is a suicide note (2011)
Ugh. Yeah, this misses the point: not everyone wants their content archived. Of course, there are no feasible technical means to prevent this from happening, so robots.txt is a friendly way of saying "hey, don't save this stuff." Just because theres no technical reason you can't archive doesn't mean that you shouldn't respect someone's wishes.

It's a bit like going to a clothing optional beach with a big camera and taking a bunch of photos. Is what you're doing legal? In most countries, yes. Are you an asshole for doing it? Also yes.

Sanzig··on Weather Radar APIs in 2025: A Founder's Complete Market Overview
If you want to go overboard, there's NOAA's Global Forecast System.

https://www.emc.ncep.noaa.gov/emc/pages/numerical_forecast_s...

Updated four times per day and has predictions out to about two weeks. It's used as the core input of most weather forecasts.

Sanzig··on NIST Finalizes 'Lightweight Cryptography' Standard to Protect Small Devices
Makes sense! Also, how does Speck fare in power analysis side channel attacks vs Ascon? My understanding was that was also one of the NIST criteria.
Sanzig··on NIST Finalizes 'Lightweight Cryptography' Standard to Protect Small Devices
Eh, the problem with AES is side channel attacks in software implementations. They aren't necessarily obvious, especially if you're deploying on an oddball CPU architecture.

This standard targets hardware without AES accelerators like microcontrollers. Now, realistically, ChaCha20-Poly1305 is probably a good fit for most of those use cases, but it's not a NIST standard so from the NIST perspective it doesn't apply. Ascon is also a fair bit faster than ChaCha20 on resource constrained hardware (1.5x-3x based on some benchmarks I found online).

Sanzig··on NIST Finalizes 'Lightweight Cryptography' Standard to Protect Small Devices
Speck? To my knowledge there aren't any serious flaws despite a lot of public cryptanalysis. I think what sank Speck was that it came out a few years after after the Dual_EC_DRBG fiasco and nobody was ready to trust an NSA developed cipher yet - which is fair enough. The NSA burned their credibility for decades with Dual_EC_DRBG.
← PreviousPage 4 of 14Next →