HNHacker News
TopNewBestAskShowJobs

rockostrich

1,148 karma · joined September 26, 2016

engineer at hopper
submissionscomments
rockostrich··on A16Z-backed data firms Fivetran, dbt Labs to merge in all-stock deal
And paying to eliminate competition along with way...
rockostrich··on A16Z-backed data firms Fivetran, dbt Labs to merge in all-stock deal
Fivetran isn't really much of a transformation layer so this is likely just a move to lock-in customers of both companies by upselling an ingestion/transformation layer to existing customers.

The bigger question mark to me is that Fivetran recently acquired Tobiko, the company behind a dbt competitor SQLMesh. The Tobiko team said their focus has been on dbt-compatibility because a lot of Fivetran customers use dbt for their transformation layer. I fear it may have just been a way to get rid of competition leading up to this deal. I can't imagine Fivetran spent a ton of money just to have 2 products that do very similar things.

We use both open-source SQLMesh as well as their cloud offering Tobiko Cloud. Following the acquisition, we were annoyed that focus was going to go to dbt compatibility because there was a bunch of stuff on their roadmap that would help us that was now deprioritized. Thankfully, they still offer great support to us and delivered a few features that have given us some quality of life improvements. With this announcement, I'm worried we're going to end up being forced to migrate to dbt...

rockostrich··on Chess.com regional pricing: A case study
I don't think it'd be illegal in the case of the US though.
rockostrich··on Indefinite Backpack Travel
Not sure if you have a background outside of software engineering, but as someone who got a degree in mechanical engineering and then shifted over to software engineering I've landed on home/car maintenance as a pretty good base hobby to fall back on. There's always more to learn, you can do most of it with a pretty limited set of tools, and it has the added bonus of improving daily life.

This may be a bit specific to me since I bought an older house and car in the past year and they require a bit more TLC. My partner and I painted all of the rooms (tools are just paint, brushes, and rollers). I've replaced almost all of the outlets and switches, including putting in a few zigbee switches (Sonoff ZBMINIR2s to be specific) since we have no overhead lights in any of our rooms and the switches don't control the right outlets... The only tools for that work are a screwdriver and a wire stripper. We also hung some cabinets in our living room and put up some bookshelves (made easier with power tools, but possible with hand tools). When it got warm, we did a bunch of work outside including some brick edging (bucket, mason line, and a trowel) and a fire pit (shovel, level, rake, and tamper).

Cars require some more tools but you can do pretty much every bit of maintenance work with a standard set of wrenches, a jack, and jack stands.

Everything just sits against the wall or in a toolbox in the garage. It's a big 2 car garage but it fits a home gym set-up, a TV on a cart, a workbench, a bunch of furniture that we need to get rid of on FB Marketplace, and there's still room to pull in a car (mine is in there right now since I'm changing the spark plugs).

rockostrich··on Indefinite Backpack Travel
As always, moderation is important for any normal person. I think that applies to minimalism as well. Use it to cut unnecessary stuff out of your life, but unless you're some outlier then it's probably not good to try and live the most minimalist life that you can without causing some terrible mental health effects along the way.

> I’m shedding hobbies and interests that I have because I believe that they’ve become distractions that I bury myself in.

Maybe you just haven't found the right hobby? Hobbies should feel rewarding, not like a distraction.

rockostrich··on Indefinite Backpack Travel
> It turns out that climbing on the hedonic treadmill is practically effortless, but sliding down it is full of splinters.

Not sure if I'm missing a joke, but the whole point of the analogy being a treadmill is that there's nothing to fall down. Regardless of positive (running forward) or negative (going backward on the treadmill) life changes, your happiness will probably stay relatively consistent because you're on a treadmill and there's nowhere to go.

The live out of a backpack lifestyle is definitely a unique way to experience the modern world and I'm sure it's fulfilling for the author, but you can even tell in their post that life caught up with them somewhat and they needed to start staying in one place a little longer in order to maintain social relationships. Their linked post about walking every block of Manhattan and tracking all of their movement since 2015 feels like the exact opposite of a minimalist lifestyle and it seems to me like they live out of a backpack not out of some anti-materialism lifestyle, but instead just as a practical way to fuel this obsession with traveling and tracking.

I admit, I've seen the author's Instagram story about walking 100k steps in a day in NYC and watched the whole thing because it's interesting, but I also take that and posts like this with a grain of salt. I'll happily take my horde of shit I need to get rid of in the garage over obsessing about how I can optimize tracking my every movement.

rockostrich··on I bought the cheapest EV, a used Nissan Leaf
One pedal driving means you can come to a full stop and start accelerating again with a single pedal. You can certainly come to a full stop in a manual transmission car without touching the brake pedal or clutch but the engine will stall and you won't be able to accelerate again until you restart it and get the car back in gear. AFAIK no ICE cars have one pedal driving although I guess it's possible to implement sans the regenerative braking.
rockostrich··on I bought the cheapest EV, a used Nissan Leaf
> This shouldn't really big a big deal in most metro areas

Not sure which areas you're referring to but in the Northeast EV infrastructure around the metro areas is not the best. In my experience, I would have to plan out my stops if I was driving between Philly and NYC if I didn't have a 90+% charge and even then I would be worried that there would be a line or chargers would be out of order.

Taking a look at an EV map, there's only half a dozen stations around NYC with 100+ kW chargers and almost all of those chargers are in-use at 2 pm on a Saturday. Sure you can go to a slower charger or just wait, but it's a pain in the ass if you are trying to plan out a trip and show up on time.

rockostrich··on I bought the cheapest EV, a used Nissan Leaf
> I hate every time I have to jack up my car and change the brakes, or take it in for oil/fluid changes

This is is such a weird take. Most EVs weigh a lot more than a ICE car (although the Leaf is about the same as most normal sized sedans) so the brake pads wear more quickly. And anyone that takes the time to change their brakes is likely doing their own oil changes because it takes 15 minutes.

The rest of the write-up is pretty spot on though. I leased a Hyundai Ioniq 6 2 years ago because I thought I would enjoy the driving experience. I was living in Philly and at the time it was my only car so I used it for trips to other parts of the city as well as any driving around the northeast to see friends and family. It's amazing for local driving, but doing any kind of drive that was more than 100 miles was a logistical pain. Even if you plan out the stops, you are still constantly worrying about whether or not there will be a long line to charge or the chargers themselves are broken even if they are reported as working in the apps.

I've since moved to the suburbs and my partner uses the Ioniq to commute to work because it's perfect for that. For any longer trips, we opt for our ICE car.

The only future foray I would consider with EVs is doing something like an EV conversion on my kei truck. Hopefully the Slate and Telo are the start of a wave of small EV trucks because I love the idea of a small truck that I can use to bring to Home Depot or to pick up larger FB Marketplace purchased.

rockostrich··on Google's Liquid Cooling
It's done sparingly. If you search for "data center waste heat uses" you'll find cases like you mention [1] [2] but the ROI on implementing it seems to be lower than renewable energy infrastructure.

[1] https://www.informationweek.com/sustainability/reusing-waste... [2] https://www.techspot.com/news/97995-data-center-uses-waste-h...

rockostrich··on Attention Is the New Big-O: A Systems Design Approach to Prompt Engineering
Not sure if this is a part of it, but there are places where "engineer" is a protected title that requires a degree or license. I work with a bunch of folks in Quebec and they have to use the title "software developer" unless they are a member of the Order of Engineers. I find this to be pretty silly considering someone can have a degree in Mechanical Engineering and use the title "Software Engineer" but someone with a degree in Computer Science can't.
rockostrich··on To be a better programmer, write little proofs in your head
Don't most slice methods behave this way? Javascript's `Array.prototype.slice`, Java's `Arrays.copyOfRange`, Golang's slicing syntax is similar to Python's except the 3rd value is the max size of the resulting slice rather than the step value all behave this way.
rockostrich··on Async Queue – One of my favorite programming interview questions
Other fields definitely involve similar lines of questioning in interviews. Medicine and law are special cases because they have their own set of standards that must be passed before you can even get an interview, but private equity interviews definitely include case studies/technical questions in a similar vein to the one shared in this post.
rockostrich··on Build Systems à la Carte (2018) [pdf]
> is nothing more than digital carpentry

Or you could just call it what everyone has been calling it for the past 20 years and say "software engineering."

rockostrich··on The Power and Beauty of Incrementalism
Just dial into the harmonics generated by the voice of Scott Stapp combined with the rev of a 1993 JDM Impreza WRX and let it be your guide.
rockostrich··on I built something that changed my friend group's social fabric
We're all aware of this and we have multiple people working in the defense industry with high clearances in the server. If something needs to be shared that can't be made public then it doesn't go in Discord. This covers about 99.9% of our correspondences.
rockostrich··on I built something that changed my friend group's social fabric
I think Discord is the best chat app for friend groups and it's not even close. At this point I've written the following bots specifically for my friend group's server:

# Music Quiz Bot

Existing apps work ok. A lot of paid and don't let you use a specific Spotify playlist.

The only thing annoying about this one is that none of the Discord API wrappers handle audio very well so I've found that this one gets a bit flaky if you're trying to play a lot.

This one is probably like 500 lines of Typescript but a lot of that is for the Spotify API. The game logic is pretty minimal.

# Birthday Bot

This is like 10 lines of Python. It's a cron that reads from a Google Sheet my friends and I keep up to date with personal information. If it's someone's birthday then it'll post a happy birthday message to them.

# Plex Bot

I wrote this before I discovered that Overseerr just has this built-in. My Plex was set up with a webhook to hit whenever new media was downloaded. The bot would post to a specific thread with the metadata about the new media. This included another webserver for serving the cover art from the private Plex metadata server.

# Movie Quiz Bot

Similar to the music bot although I don't think existing apps exist that do this. Essentially it's https://framed.wtf/ except as a game in a Discord channel where random frames are pulled from movies in my media library and everyone competes to name the movie first. This one required some ffmpeg fun to make pulling the stills not take forever. I considered doing static stills or having a cronjob do it, but it's more fun when it's completely random.

rockostrich··on The $25k car is going extinct?
This doesn't really have anything to do with the US though. Importing that vehicle is not possible for another 24 years and USD$15k goes a lot farther in southeast Asia than it does in the US. For the past half century there has been a plethora of cheap pick-up trucks available in Asia and that has not carried over to the US.
rockostrich··on The Power and Beauty of Incrementalism
This comparison feels like it's in very poor taste. The article doesn't promote any kind of ostracizing and certainly isn't promoting that anyone in the community is forced to be there. Making friends, especially with people who already probably have their own social lives, tends to be a lot harder than maintaining friends. It's completely valid for people who are already in each other's social circles to plan to live close to each other.

My partner and I moved into a house on a pretty secluded street of a very suburban township. There are 5 houses on the block. We're friendly with everyone but we're all in very different periods of our lives. Two of the houses have younger kids, one has older kids, and one is empty nesters. They're all super nice and we're friendly, but none of them are coming over to lift heavy weights in the garage while Creed is blasting.

rockostrich··on Backyard Coffee and Jazz in Kyoto
As someone who loves coffee as well as the culture around locally owned coffee shops, visiting Tokyo (and to a lesser extent Seoul) this past April was like a dream come true.

When my partner and I travel, we don't do a ton of planning for specifics so if we're in a big city we'll usually pick a neighborhood or 2 for the day and bebop around until we're tired. The start to any day is almost always finding a coffee shop and doing the crossword during our first cup. In Europe depending on the city this can be difficult because a lot of coffee shops just pump out overextracted espresso and then give the option to add water for an americano. There's still tons of amazing cafes in the European cities I've visited. Some really memorable ones are Café Tacuba in Lucerne, Faro in Rome, and Monks Coffee Roasters. in Amsterdam.

In Tokyo, we actually started off with a pretty mediocre coffee because nothing opened before 10 besides a cafe chain, but after we got adjusted we couldn't stop finding great spots. The first day we were going to the national museum and found AOYAMA COFFEE ROASTER in Yanaka. At first the owner was a bit standoffish because we were 2 Americans coming in at the very beginning of the day and I assume she has a lot of bad experiences with tourists, but we started talking after she noticed my portafilter/coffee plant tattoo and had a really great time. For the rest of the week, we walked into shop after shop that had at most 4 or 5 seats with one barista making drinks and each one felt special.

The one that connected me most to this post was the one from our day in Sumida City when we were going to a bunch of small museums (highly recommend the Hokusai museum). We stopped into CHILL OUT COFFEE &...RECORDS and it was one of the coziest coffee experiences I've ever had. The shop is a coffee bar with a couch and a couple of chairs. I forget what kind of cup I had but I remember it being just a really balanced cup with a little bit of berry and chocolate notes. I wish we could've stayed longer but after about 15 minutes a family of tourists with 2 toddlers came in and we figured it was time to go after we finished our drinks.

In Seoul, the shops we visited were all a lot bigger but one thing I couldn't help noticing was that all of the baristas were so deliberate in their movements. This is something that was probably true of folks in shops in general in Tokyo and Seoul, but I noticed it with baristas because I tend to think about it a lot when I'm making drinks at home. You could show me a silhouette of baristas making drinks in Tokyo and some western city and it would be night and day. I feel like that goes a long way in illustrating the differences between eastern and western culture even though we're all making and enjoying the same hot bean water.

rockostrich··on Dilbert creator Scott Adams says he will die soon from same cancer as Joe Biden
I can't find anything super relevant while searching for Shandling and manifesting, but considering he was known for being a practicing Buddhist and a big proponent of meditation I wouldn't be surprised if he believed that writing down his goals is a good first step in achieving them.

Adams's version of manifesting is "if you write stuff down, it's more likely that outcomes outside of your control will help you achieve your goal."

Those are not the same thing.

rockostrich··on Launch HN: ParaQuery (YC X25) – GPU Accelerated Spark/SQL
> I started working on actually deploying a cloud-based data platform powered by GPUs (i.e. Spark-RAPIDS)

Based on this, the platform is using Spark-RAPIDS.

rockostrich··on A $20k American-made electric pickup with no paint, no stereo, no screen
I'm in NJ so as long as it's 30 years or older there's no emissions required. If you're in a state that doesn't allow registration of kei trucks then there are companies that make it pretty straightforward to get them titled and registered in states that have very lax laws like Montana.
rockostrich··on A $20k American-made electric pickup with no paint, no stereo, no screen
Damn, that's a great deal. And yea, $5k seems to be about the bottom of the barrel in terms of getting a decent car.

For my "daily" driver (I drive a few times a week and it's rarely more than 20 miles), I ended up buying an imported WRX on an auction site. Cost more than a used Honda Fit but it's a ton of fun to drive.

rockostrich··on A $20k American-made electric pickup with no paint, no stereo, no screen
> used, 100k miles or so, if you shop around $2k-$3k should be doable

Where are you finding a 100k mile Honda Fit for $3k? Before I bought my current daily driver, Honda Fits were on my list to look out for and in the central NJ area I never saw one in decent condition around that mileage for less than $5k. Even looking now I see people trying to part out theirs for $2k or looking for $4k for a 200k mile one. I messaged someone on FB Marketplace that had a 2013 with 65k miles on it to try and bring down their $11k asking to $8k and just got ignored.

NJ is probably on the higher end of the market but the deviation can't be that big.

rockostrich··on A $20k American-made electric pickup with no paint, no stereo, no screen
> I do see this being great for short utility trips (think running errands, picking something up, etc), and as a utility vehicle (would be nice to be able to have an 8ft bed).

Japan and the rest of the world figured this out decades ago. They're called kei trucks. You can buy pre-2000 imported ones in the US from like $5-15k depending on the miles/condition/year/transmission. I have a 1990 Suzuki Carry that is solely used for trips to Home Depot and picking up random furniture from FB Marketplace that I got for $6k.

rockostrich··on Next generation LEDs are cheap and sustainable
I think it's a good idea in general to just try and replace every switch and outlet if you buy a home that was lived in for an extended period of time. We moved into a home that the previous family lived in for 30 years and I've been working my way through replacing everything. I've found some crazy work in some of the junction boxes. Most weren't grounded which isn't super surprising. Many were wired incorrectly which is a little less surprising.

Also it's a good exercise in making sure the electrical panel is labeled correctly. Ours was somehow only labeled like 75% correctly.

rockostrich··on Building an Open, Multi-Engine Data Lakehouse with S3 and Python
Toby and the team at Tobiko really are a pleasure to work with. They have strong opinions but have shown a good amount of willingness to implement features as long as there's a strong general use case. We've been working with them for almost a year now and it's really interesting seeing a early-ish open source library being developed by a start-up develops (and how much influence you can have over the direction if you work closely with the dev team).
rockostrich··on Apple will soon receive 'made in America' chips from TSMC's Arizona fab
Hit the nail on the head. I went to the College of Nanoscale Science and Engineering in Albany for a master's in "nanoscale engineering" which essentially boiled down to a master's in being a fab line manager. I finished the degree since it was only a 3 semester program and I was getting paid for research work, but almost immediately after chatting with alumns that went to go work at IBM/Intel/etc it was pretty clear that software engineering was a much more lucrative and less stressful career.
rockostrich··on A new JSON data type for ClickHouse
Analytical databases have rows and columns? What do you do when you're ingesting TBs, if not PBs, of unstructured data and need to make it actually useable.

A couple of MBs (or even GBs) for storage for metadata is peanuts compared to the actual data as well as the material savings when storing it in a column-oriented engine.

← PreviousPage 3 of 16Next →