HNHacker News
TopNewBestAskShowJobs

mrich

2,292 karma · joined October 30, 2010

I work on a distributed in-memory database at SAP SE.

- Previous projects: https://richtarsky.com/docs/projects.html

- Github: https://github.com/mrichtarsky

www.productive-cpp.com

s@martinien.de

submissionscomments
mrich··on Ask HN: What services/apps are you self-hosting?
I'm looking for a good source code search solution that has navigation (browser based), and lets me add local repos. I have used Sourcegraph before and would use that, but perhaps there are better alternatives?
mrich··on Ask HN: What services/apps are you self-hosting?
Internet

- Bitwarden

- Nextcloud

- Transmission

- Dokuwiki

- Selfoss (Feed aggregator)

- Postfix/Apache for a few domains (currently forwarding emails but will add self hosting)

- WebDAV

Local network

- Photoprism

- Samba

- eblocker for network-wide tracker/ ad filtering

mrich··on Ask HN: What are your “scratch own itch” projects?
Encrypted backup to AWS Glacier Deep Archive ($1/TB/month)

https://github.com/mrichtarsky/glacier_deep_archive_backup

And for ErgodoxEZ:

Compress your keymap so you can add more features without hitting the limit

https://github.com/mrichtarsky/ergodox-compress-keymap

Generate Heatmap from your keypresses so you can see whether your layout is optimal

https://github.com/mrichtarsky/ergodox-heatmap

mrich··on FTX faces potential hack, sees mysterious outflows totaling more than $600M
To be clear, even the FTX bankruptcy and the way it happened, not even taking this outflow/hack here into account, is jail worthy. The question is whether it falls under US jurisdiction and whether the defense lawyers can be paid enough to somehow avoid this, or postpone for a decade or so.
mrich··on FTX faces potential hack, sees mysterious outflows totaling more than $600M
People will be going to jail for this. Do not take the short term view.
mrich··on Ask HN: Have you stopped reading most news?
I have done the opposite: I'm reading much more than before. But instead of reading only one mainstream news outlet, I'm now subscribed to a variety of quality RSS feeds. These include news, blogs, Hacker News, startup stuff, financial. Across these I get around 400 headlines per day which I skim, and read about 5% of the most interesting. This gives me a great overview what is going on and I can go in depth on the interesting parts.

I'm using selfoss as feed reader. News sources I can recommend:

  - Financial Times (you can select the categories that interest you and build a feed from them)
  - Economist
  - Techcrunch
  - The Register
  German:
  - Faz
  - Handelsblatt
mrich··on Prepare for the OpenSSL 3.x Secvuln
Had quite a few packages updated on my Ubuntu servers today and believed it was this issue. But seeing this is still embargoed it looks like these weren't updates for this problem? Or is Ubuntu releasing binaries but keeping the sources embargoed?
mrich··on Our conscious experience of the world is a memory, says new theory
There's a great book describing how to get into that state, and explaining how that state is the key to success. Just read it last week and can recommend.

https://www.goodreads.com/book/show/905.The_Inner_Game_of_Te...

mrich··on GM created a new energy business to sell batteries and solar panels
Would love to pay a premium for having V2H functionality for my next car, but most manufacturers don't support it yet, and the utilities don't easily either. It would save me from buying an additional battery which in addition to the high cost will take up more space inside the house and is also a fire risk.
mrich··on Muon: GPU Based Electron on a Diet
> JavaScript felt like something that would never mature into anything. Hell, I was in my late teens so the feeling was likely mutual.

Just want to say thanks for this gem ;)

mrich··on Stadia died because no one trusts Google
H
mrich··on Fork of the popular “I don't care about cookies” extension
The settings are available though, are they not working?
mrich··on Show HN: Low-cost backup to S3 Glacier Deep Archive
Thanks for the pointer. gpg is the better option then, I've switched to it.
mrich··on Show HN: Low-cost backup to S3 Glacier Deep Archive
It's aes256 using openssl:

https://github.com/mrichtarsky/glacier_deep_archive_backup/b...

Does that leak information you would be concerned about?

It's always a full backup.

mrich··on Show HN: Low-cost backup to S3 Glacier Deep Archive
I checked it, it's quite good. Also during restore, waits for the files to become available for download. But personally I don't like the fact that files are packed into some blob storage, which is not as easily accessible as a tar archive.
mrich··on Show HN: Low-cost backup to S3 Glacier Deep Archive
Checked it, it uploads single files. This is very expensive. Also, they only have server-side encryption. Also cannot handle restore :(
mrich··on Show HN: Low-cost backup to S3 Glacier Deep Archive
Edit: Can do restore, but it's a manual step.
mrich··on Show HN: Low-cost backup to S3 Glacier Deep Archive
But you would pay quite a lot for the time your data is still in S3 blob, no?
mrich··on Show HN: Low-cost backup to S3 Glacier Deep Archive
As mentioned in another reply below, I found these issues with rclone, perhaps you can tell if I'm missing something:

- It will not create archives by default, so potentially upload a lot of files (just like rsync). There are a few workarounds in the documentation to mitigate the cost.

- It cannot do restore of Deep Archive data

Edit: Can do restore, but it's a manual step.

mrich··on Show HN: Low-cost backup to S3 Glacier Deep Archive
Wasn't aware of this :) The problem is that this will sync files as-is without creating archives. Not sure how it's implemented internally, if they're using a single request per file this would get expensive quickly. In any case it will be much more expensive since each file costs a small extra amount for storage. Also curious whether they can handle auto restore during sync cloud -> local. Will give it a try.
mrich··on Show HN: Low-cost backup to S3 Glacier Deep Archive
You are right, I will mention this in the README. Note that the script creates archives for this purpose, it does not store single files. E.g. in my local setup I have an archive size of 50 GiB, so 20 files/terabyte. This makes the API costs negligible.
mrich··on Show HN: Low-cost backup to S3 Glacier Deep Archive
Hmm, conflicting info?

https://aws.amazon.com/s3/faqs/

> Individual Amazon S3 objects can range in size from a minimum of 0 bytes to a maximum of 5 TB.

https://docs.aws.amazon.com/amazonglacier/latest/dev/uploadi...

> Using the multipart upload API, you can upload large archives, up to about 40,000 GB (10,000 * 4 GB).

Since the archive must be restored to S3 before download, I wonder what will happen if you upload and restore a 5 TB + 1 byte archive?

mrich··on Show HN: Low-cost backup to S3 Glacier Deep Archive
rclone seems to fit the bill:

https://rclone.org/

mrich··on Show HN: Low-cost backup to S3 Glacier Deep Archive
How does Arq store your files on Deep Archive? Does it create archives or create the same structure you have locally?
mrich··on Show HN: Low-cost backup to S3 Glacier Deep Archive
I found two problems with rclone, would be interested to hear if I misunderstood anything or if you have a workaround:

- It will not create archives by default, so potentially upload a lot of files (just like rsync). There are a few workarounds in the documentation to mitigate the cost.

- It cannot do restore of Deep Archive data

mrich··on Show HN: Low-cost backup to S3 Glacier Deep Archive
I understand, didn't see this mentioned on the pricing page directly. How do they store the data in Deep Glacier (single files or archives? the former would be very expensive?) Do they have restore fully integrated? (since this is a two-step process that takes 12+ hours I could imagine it does not fit the normal flow)
mrich··on Show HN: Low-cost backup to S3 Glacier Deep Archive
> Note that, in the event of retrieval, it's not just per GB, it's also per request.

This should fall in the free tier in most cases, since the script creates archives of the specified size. The free tier has a few thousand requests for free.

mrich··on Show HN: Low-cost backup to S3 Glacier Deep Archive
But you get 100 GiB/month free download :)
mrich··on Show HN: Low-cost backup to S3 Glacier Deep Archive
It's not my claim, here's the link to the AWS page:

https://aws.amazon.com/s3/storage-classes/#____

You could upload to multiple regions just to be sure.

mrich··on Show HN: Low-cost backup to S3 Glacier Deep Archive
Thanks, sounds interesting, will take a look. Do they store files 1:1 or do they create tar archives? Single files are quite ineffective on Deep Glacier.
← PreviousPage 2 of 19Next →