HNHacker News
TopNewBestAskShowJobs

acidbaseextract

576 karma · joined August 7, 2016

submissionscomments
acidbaseextract··on Fsspec: Filesystem Interfaces for Python
I'd give the a thumbs up to smart_open. Happily used it to have our servers parse data dumps of up to several hundred megabytes on user-configurable remote storage without drama. Seems like it could handle larger files without issue, but we haven't had need to push it.

I can't speak to fsspec, but their filesystem functionality (eg. `ls`, `cp`) isn't something that smart_open has and it does look cool.

acidbaseextract··on AMD Demonstrates Stacked 3D V-Cache Technology: 192 MB at 2 TB/SEC
Multilayer interconnect or multiple layers of transistors?
acidbaseextract··on Stacked Git – manage commits as a stack of patches
Describing a patch queue development workflow as a "slightly nicer interface to interactive rebase" does it a tremendous disservice. It's like saying "a database is a slightly nicer interface to a filesystem" — technically true, but a disservice.
acidbaseextract··on Stacked Git – manage commits as a stack of patches
It seems like Phabricator supports this type of workflow, and I really wish there was wider popularity so I could push for it at work. The lab|hub style PR ends up with people falling into giant PRs that are difficult to review.
acidbaseextract··on Stacked Git – manage commits as a stack of patches
Funny to hear that you learned patch queues with mq. mq was my favorite part of mercurial and it's how I learned to use patch queues too.

Thank you for maintaining StGit — I really enjoy it as a tool! topgit is fine, but quite heavy. I don't use stg much at work with squash merge workflows, but I love it for personal projects or when I need to work on a series of commits with intricate change sequencing.

acidbaseextract··on Let’s Talk About Hot Tub Streams
Probably the lost ad revenue. No company wants to advertise on those streams. By breaking them out in way where advertisers could opt out of that stream category, suggestive streamers (a huge segment of traffic) would lose money for Twitch.
acidbaseextract··on Ampere switching to in-house CPU designs
https://conferences.computer.org/isca/pdfs/ISCA2020-4QlDegUf...

"Xuantie-910: A Commercial Multi-Core 12-Stage Pipeline Out-of-Order 64-bit High Performance RISC-V Processor with Vector Extension"

From "VIII. NON-STANDARD INSTRUCTION SET EXTENSION"

Targeting at various industrial applications, XT-910 enables a set of custom non-standard instructions, additional to the standard RISC-V instructions. The non-standard instruction extension can be categorized into two groups based on the purposes - memory access enhancement, and basic arithmetic operation enhancement.

A. Memory access enhancement

Memory access instructions usually account for a high proportion in the total number of instructions, so enhancing memory access instructions can directly benefit the overall performance. By analyzing the mainstream applications running on RISC-V, we observed that for the basic RISC-V instructions there is still quite some room for improvement in memory access related instructions.

First, we support register + register addressing mode, and support indexed load and store instructions. This type of instruction extension reduces the usage of the registers for calculation and reduces the number of instructions for address generation, thereby effectively accelerating the data access of a loop body. Second, unsigned extension during address generation is supported. Otherwise, the basic instruction set does not support direct unsigned extension from 32-bit data to 64-bit data, resulting in too many shift instructions.

I'm not certain if they break out the results by individual optimization, but in Fig. 20 in the paper it looks like all their tweaks add up to a 20% boost over the standard RISC-V ISA. Pretty huge.

acidbaseextract··on Using PostgreSQL as a Data Warehouse
I'm glad I'm not in the situation of needing to make the judgement call, but Postgres' ecosystem might be part of the answer. For example, Snowflake has basic geospatial support, but PG has insane and useful stuff in PostGIS like ST_ClusterDBSCAN: https://postgis.net/docs/ST_ClusterDBSCAN.html

Foreign data wrappers are another thing that might be compelling — dunno if Snowflake has an equivalent.

I don't have any numbers but PG has served me fine for basic pseudo-warehousing. Relative to real solutions, it's pretty bad at truly columnar workloads: scans across a small number of columns in wide tables. The "Use Fewer Columns" advice FTA is solid. This hasn't been a deal breaker though. Analytical query time has been fine if not great up to low tens of GB table size, beyond that it gets rough.

acidbaseextract··on Why do we buy into the 'cult' of overwork?
Eh, want is a subtle thing. There's a lot of research around women's declining happiness since the 1970s[1], which implies this change is not an unalloyed good. I blame marketing. A lot of marketing tells women what to want, and marketers certainly have zero incentive to steer women away from consumerism, a career to finance that consumer lifestyle, or the idea that such a lifestyle is "freedom".

[1] https://www.theguardian.com/lifeandstyle/2016/may/18/womens-...

acidbaseextract··on The Sovietisation of the Mongolian language and challenges of reversal (2020)
I'm not even Indian and it's shocking that anyone thinks unification around Hindi will happen. Good luck getting Dravidians onboard with cultural imperialism from the north. To my mind the legacy of English colonialism allows north and south India to remain unified because there's a "fair", common third option provided in cultural conflicts between the north and south. That is exactly what the English language is as a national choice.
acidbaseextract··on Show HN: Atuin, improved shell history with multi-machine sync
Really cool! Needs more upvotes! I do kinda this with Dropbox, but way more crappy.
acidbaseextract··on My MacBook Air M1 is dead
The style was obnoxious I agree. If you're interested in buying an M1 MacBook — I wouldn't buy without being aware of the need to watch SSD writes. It seems like M1 devices with low memory have scenarios that they will use their SSDs crazy hard.
acidbaseextract··on Branch predictor: How many “if”s are too many?
As you point out, the exact properties that make binary search algorithmically fast can slow it down on real computer hardware.

Branch predictors like low entropy (unsurprising) branches, but binary search is algorithmically fast because it maximizes the entropy (information gained) from the few branch checks that it does make.

acidbaseextract··on Thoughts on a “HDD shortage” from an industry insider
To echo the other commenters, mining is pretty gentle on GPUs insofar as constant use goes. ETH is memory bandwidth limited, so cards can be heavily undervolted and underclocked (while overclocking memory) saving power without negatively affecting hashrate. More power is wasteful. Typical ETH mining GPU temps are around 60C. I'd feel ok about buying a used card off someone who knows what they're doing mining.

The 3080 and 3090 are the singular exception. The GDDR6X runs extremely hot and frankly I think it's going to cause a bunch of early failures for even non-mining cards.

acidbaseextract··on Best practices for remote software engineering
I had a coworker with ADHD and I'm pretty sure he was prescribed stimulants although he was discreet about it. His patterns of focus were idiosyncratic, and occasionally he wrote code that just oozed "hopped up on addy" stylistically — particularly spurious and superfluous abstractions.
acidbaseextract··on TSMC sees chip shortage lasting into 2022
Which points out the the real answer to the question: Nvidia doesn't want it solved. Not just that they don't care, but they're making more money now — so they don't want it solved.
acidbaseextract··on The latest DSM update makes btrfs drives unavailable on budget Synology models
Here's a detailed review that answers that question: https://www.servethehome.com/ixsystems-truenas-mini-x-zfs-na... (the video linked there is also good)

On page 5 they tally it up as a $400 difference vs building your own.

acidbaseextract··on The latest DSM update makes btrfs drives unavailable on budget Synology models
I built a 6 disk TrueNAS Raid-Z2 box two years ago and though it was inconvenient to build vs buying something off the shelf, TrueNAS has been excellent. Does what it says on the tin and continually improving with each release.

Their cloud sync and UPS functionality have been great (flaky power around here). Haven't dug into the TrueNAS' ZFS pool/snapshot management and jails management (FreeBSD's containers) functionality, but both are compelling once I get time and a good project for them. The NAS performing so well has me itching to upgrade to 10 gigabit ethernet around the house once prices come down a bit.

Also I ran the OS off mirrored thumb drives until recently. That was pretty nifty.

acidbaseextract··on [dead]
https://en.wikipedia.org/wiki/Tontine

I had thought they were illegal, but Wikipedia says otherwise.

acidbaseextract··on Git as a NoSql Database (2016)
Completely agreed on the inevitability of that ask.

At risk of extreme overkill the other way, something like Debezium [1] doing change monitoring dumping into S3 might be a viable industrial strength approach. I haven't used it in production, but have been looking for appropriate time to try it.

[1] https://debezium.io/

acidbaseextract··on Proposal: Downward Assignments
Mentioned in another sub-comment, but Clojure's threading macros do this. They do it by making positional assumptions about the implicit argument: https://clojure.org/guides/threading_macros
acidbaseextract··on Proposal: Downward Assignments
Clojure's "threading" macros are exactly this: https://clojure.org/guides/threading_macros

Elixir's pipe is the same thing, though Clojure has a few extra forms to facilitate other variable passing patterns.

acidbaseextract··on Ubiquiti starts serving ads in their management interface
With the depth of your experience, what's your prosumer recommendation? MikroTik?
acidbaseextract··on Developer tools can be magic but instead collect dust
Companies often want to release incremental, small features, not major UI overhauls.

Speaking as a product leader who has been in a position to decide on these, I'm not opposed to major UI overhauls, but many that have been proposed to me:

- Are motivated by a design team that wants to justify their jobs or make a mark on a product, with the UI considerations secondary.

- Have major issues and design weaknesses themselves.

- Throw out important aspects of functionality in an attempt to be "fresh and simple".

- Ignore that we had our last major overhaul 12 months ago, and that one was in response to the major ovehaul 24 months ago.

Requiring evolution rather than revolution is a hedge against these problems. I'm not generally opposed to overhauls because I'm familiar with the importance of UI. For example, I'm very unhappy with Robinhood as a trading platform, but damn, switching to Fidelity is painful because their UI is so terrible.

I wish I more consistently got to work with talented designers. I put a lot of effort into getting good designers, as poor designers can wreak havoc.

acidbaseextract··on Standard Ruby 1.0
Another vote for prettier for JS/TS. The primary projects I work on we made some slight tweaks to the default style (wider line width) and though some people were unhappy about adopting a formatter, there have been zero beefs with prettier's actual output among an opinionated group.
acidbaseextract··on Dolt is Git for Data: a SQL database that you can fork, clone, branch, merge
How do you send someone a git repository as a file? Why would a tarball not work?
acidbaseextract··on Graphtage: A semantic diff utility for JSON, HTML, YAML, CSV, etc
I don't currently have access to the machine and files that I was doing it on, but I'll try those in the morning!
acidbaseextract··on Graphtage: A semantic diff utility for JSON, HTML, YAML, CSV, etc
30 minutes in and I still don't have a diff of the two CSVs... Has this program worked for anyone here?

    Diffing:   0%|                                | 153/93195 [30:02<151:31:17,  5.86s/it]
    Tightening Fringe Diagonal 82 of 792:  48%|...| 7453/15514 [00:30<00:35, 226.08it/s]
acidbaseextract··on Graphtage: A semantic diff utility for JSON, HTML, YAML, CSV, etc
It's cool, but does seem quite slow. I'm diffing two 45kB CSVs on a fast computer and after 10 minutes I'm still at:

  Diffing:   0% ... 0/93195 [00:00<?, ?it/s]
  Tightening Fringe Diagonal 48 of 792: ...
acidbaseextract··on The Cuboid: A DIY air purifier that's better than a box fan
Great site! I love the "What happens if you drink acetone?" article: https://dynomight.net/2020/09/14/what-happens-if-you-drink-a...
← PreviousPage 2 of 6Next →