HNHacker News
TopNewBestAskShowJobs

jimmytucson

1,470 karma · joined February 16, 2012

Software engineer specializing in data engineering, language technology, ML, and search. Reach me at my HN username at fastmail.com.
submissionscomments
jimmytucson··on Compare Google, Bing, Marginalia, Kagi, Mwmbl, and ChatGPT
> Why would an average user want blog spam search results?

I didn’t say they would :)

In fact, I can’t figure out how your comment relates to mine. Are you claiming that Google doesn’t factor blog spamminess into its evaluation of search results? If so, that’s quickly put to bed by the document I linked, pretty much section 4.6. Excerpt:

> Creating an abundance of content with little effort or originality with no editing or manual curation is often the defining attribute of spammy websites.

You could claim that they fail to capture some essential quality of “blog spamitude” or that they don’t weight it heavily enough in their eval but to say they just, like, don’t know about blogspam over there, is pretty far fetched IMO.

jimmytucson··on Compare Google, Bing, Marginalia, Kagi, Mwmbl, and ChatGPT
If you wanna know why Google (or any search engine) sucks, just look at how it measures its own search results. Most search companies do this “at scale” according to very specific guidelines, like what the author did here but on steroids. For example, take a look at Google’s 168-page instruction manual for search quality raters:

https://static.googleusercontent.com/media/guidelines.raterh...

It talks about figuring out a query’s meaning(s), judging the user’s intent (were they looking for some specific answer, etc.), evaluating the “quality” of a website, rating the site’s usefulness in relation to the query’s meaning/intent, etc.

All this is to say, it’s not that search companies don’t do exactly what the author did here, it’s just that they have different standards than the author. And I’d venture their standards match their users’ better than the author’s, but maybe not or not forever, anyway.

jimmytucson··on GPT 4 has been toned down significantly?
This is becoming a familiar story - users postulating “shrinkflation” in the quality of ChatGPT’s generated responses. I wonder, can we use another LLM to grade the responses in terms of insightfulness, thoroughness, accuracy, etc. so they can be measured objectively and monitored?
jimmytucson··on A Lighthouse Keeper Hangs Up Her Bonnet
Great article. It reminds me of a beautifully illustrated children’s book called Hello Lighthouse[1], which tells the life story of a lighthouse keeper and his wife as they tend the lighthouse, get married, rescue the crew of a shipwreck, have a baby girl, and eventually move to shore after being replaced by a mechanism that turns the lamp automatically.

[1] https://www.sophieblackall.com/books/hello-lighthouse

jimmytucson··on Reddit Leads Class of 2024 IPO Candidates Testing the Water
https://archive.is/zWJb8
jimmytucson··on Ask HN: What was the outcome of Reddit blackout?
> sharp drop in July 2023

They shut off API access to their data around the very same time. Is that a coincidence?

jimmytucson··on AI Search Is Turning into the Problem Everyone Worried About
https://archive.ph/7PGMJ
jimmytucson··on The five filters of the mass media
One thing I've never been able to work out is, if this model were true, how would we ever hear about it? Why would Random House publish the book by Herman and Chomsky? Why would Al Jazeera produce this video and why would YouTube host it? These are all large media companies.

edit: I hope this question doesn't come across as petty or rude. I am a fan of Chomsky and intrigued by his thoughts on society. It's an honest question that I really have a hard time getting past.

jimmytucson··on Telling GPT-4 you're scared or under pressure improves performance
It’s interesting to think about how generative AI might shape human expression, in the same way Twitter’s algorithm rewards punchy, editorialized content, and Google’s algorithm gave life to all the generic “blogspam-y” content out there. If we increasingly interact with generative AI, would we shape our speech to get more value out of that interaction?
jimmytucson··on Reddit can survive without search': company reportedly threatens to block Google
reddit has its own search feature but it doesn’t seem like they’ve poured a lot of cash into it yet. I imagine that would change if they were to block Google and Bing.
jimmytucson··on Neanderthals hunted dangerous cave lions, study shows
Link to the paper with more context, maps, and images: https://www.nature.com/articles/s41598-023-42764-0
jimmytucson··on The midwit home
HA sounds cool to me but other than being a fun thing to work on, what's so good about it? Can anyone "sell" me on it? Is it just being able to turn stuff on and off from your phone?
jimmytucson··on Companies are making serious money with AI
I wonder what counts as an “AI investment” or a “production AI deployment”. Deploying an ML model? Sounds like it. What about paying for an ML service? Maybe. What about buying a product that uses an ML service provider under the hood for key features? I’m guessing that one doesn’t count, but that’s still indirectly investing in AI.
jimmytucson··on Archaeologists extract DNA of ancient Israelites
Exodus is not the story of the origin of the Jewish people, so its historicity has nothing to do with whether or not the Israelites are descendent from Canaanites.
jimmytucson··on Generative AI, SEO, and what leaders should know: Google search in the future
The gist of the article is that LLM-generated text will soon occupy more of the SERP, which will answer search queries without the user having to click on links, which drive down SEO traffic.

I am a little bit skeptical that this will “eat into” SEO traffic rather than create a new kind of query traffic where the user goes in wanting to engage an LLM in a discussion. The kinds of queries that are zero-clicked today, like “weather in seattle”, are more frequent because the answer is right on the SERP. Users were less likely to Google that when it just linked to weather.com and you had to run another search there to search for your zip code.

It may however cannibalize queries that are directed towards finding human discussions, i.e. searching reddit.

jimmytucson··on Reddit Removing the Ability to Opt-Out of Ad Personalization
I’m surprised reddit doesn’t allow advertisers to place ads on specific subreddits. My best guess why is that advertisers would need to be able to decide what subreddits to put their ad on, and that’s maybe not as easy as it sounds.

Let’s say my I sell mechanical keyboards. I should be able to find r/MechanicalLeyboards pretty easily but that alone doesn’t give me a huge audience. What about mechanical keyboard-adjacent subs? I could guess a few, like r/computers but I’m quickly getting out of my niche. I’d need to know my way around reddit really well, or have access to some pretty sophisticated subreddit search to find enough communities to advertise on. So why wouldn’t I just let reddit do that for me?

jimmytucson··on We are beginning to roll out new voice and image capabilities in ChatGPT
> It doesn't have to be this way!

Is there any extra work OpenAI’s product might be doing contributing to this latency that yours isn’t? Considering the scale they operate at and any reputational risks to their brand?

jimmytucson··on Show HN: Learn piano without sheet music
This is really cool! Guitar was my first instrument, then I went on to learn bass, drums, and a bunch of others, but I never bothered to learn how to read music - or, really, sight read. The few songs I know on piano, I learned from an electronic piano that had a display with an image of the keyboard and the keys would change color to tell you which one to play. When I play Maple Leaf Rag for other musicians they're often surprised to find out I can't read music.

So I can definitely see a market for this and will probably try learning another song on piano with it. That said, I do wish I had just learned to read music up front, as I learned my first instrument. I think it would have opened up doors for me, particularly for playing with other musicians (like an orchestra or a jazz band). But who knows how much longer that will be the case - tomorrow's great musicians may learn on an app like this!

jimmytucson··on Add extra stuff to a “standard” encoding? Sure, why not
> author decided it was a good idea to prepend the message with the message length encoded as a varint.

> WHY? Oh, why?!

Uh oh. Is this my HN moment?

This is exactly how I implemented it at my company. We had to write many protobuf messages to one file in bulk (in parallel). I did a fair amount of research before designing this and didn’t find any standard for separating protobuf messages (in fact, found that there explicitly isn’t a standard in that protobuf doesn’t care). So I thought rather than using some “special” control character, like a null byte, which would inevitably be not-so-special and collide with somebody else’s (like Schema Registry’s “magic byte”), I’d use something meaningful like the number of bytes the following record is.

As for why I chose varint instead of just picking an interger size, well for one I got nerd-sniped by varint encoding and thought it would be cool to try and implement it in Scala. Secondly, I thought if I chose a fixed size integer, no matter what size I pick, my users will always surprise me and exceed it at least once, and when that happens, kaboom! I wanted to future proof this without wasting 64 goddamn bytes in front of each message, and also I got nerd-sniped, OK?!?

Someone on my team recently shared one of these files outside the company and so I really hope she’s not talking about me but that’s a crazy coincidence if not!

jimmytucson··on Skip the API, ship your database
That is an appealing idea but on second thought, haven’t you just shifted the problem to: how do I reliably replicate logical updates from my operational tables (internal, constantly changing) to my clean, public-facing tables?

Basically, your public tables become materialized views over the “dirty” tables, and I’ve never met a mature, reliable implementation of materialized views, or even an immature one that is feature complete. (I would love to be wrong on the internet with this one!)

jimmytucson··on Skip the API, ship your database
I love this kind of reasoning that forces you to climb out of the comfortable nook in a tree of thought you’ve been occupying for years to see if there’s a better vantage point!

So would this work equally well? Use Postgres on some cloud and “spin up” a read-replica that your clients have access to. Let them read from the replica.

If yes, I have tried that and I can tell you the problem I had. They don’t want to get to know my database schema. I know, frustrating! “If you would just get to know me better, you would have all the secrets you desire!” Sigh… they just want this overly simplistic Interface that doesn’t change, even when we rewrite things to make them better on the backend.

Another thought: if sharing compute is the main problem, you can just egress the data to distributed file storage like S3 and let them write SQL on the files using some Presto, like Athena. Or egress to BigQuery and let them bring their own compute. But the problem there again is getting to know my internal data structure, and also by “egress” I really mean “dump the whole damn thing because once the data is on S3 I can’t just update a single row like I can on an OLTP database” and you can only do that every so often.

jimmytucson··on Altering Python attribute handling for modules
There are more inexperienced users than experienced ones, so if it really does disproportionately affect inexperienced users, it’s an even bigger problem!
jimmytucson··on Poll: What is your primary search experience?
Apparently SGE is Search Generative Experience.

Also, this is missing Reddit Search.

jimmytucson··on A cheap radio hack disrupted Poland's railway system
Great article. It goes into the radio and the audio frequencies, and talks about equipment that can transmit the signal, from handheld radios to SDRs, and even covers how to build your own (with circuit diagrams).

Much better than the article linked IMO.

jimmytucson··on For many home-schoolers, parents are no longer doing the teaching
How much time does homeschooling take for you? Does it roughly equate to one full-time job? I have wanted to homeschool my kids but I am afraid I would have to quit my job or downshift to part-time.

And since they are different ages, I worry that if I taught them all at the same time, the curriculum would average into something too challenging for the younger and not challenging enough for the elder. How do you manage to meet all their needs at once?

jimmytucson··on Ask HN: What was the Data Engineering book recently recommend in HN comments?
Was it Designing Data Intensive Applications by Martin Kleppmann?

https://www.goodreads.com/en/book/show/23463279

jimmytucson··on Ask HN: How are you preparing for worsening climate change?
In Jan/Feb of 2020, I spent a lot of time "preparing" for the Coronavirus:

- I built a pantry and stocked it with foods for storage. Beans and cheerios and powdered milk, etc. It turns out that in addition to these, I eat perishable foods, so I routinely had to go to the grocery store anyway. And while I was there, I bought regular milk, because eww.

- I bought a bunch of 5-gallon carboys and filled them up with water in case, y'know, the apocalypse. Never had a water problem (thankfully).

- I stocked up on bleach, masks, and other PPE. And of course it turned out the bleach wasn't super useful because the virus spread mainly through the air. The masks were the only effective prep I made, but then I felt extremely bad about hoarding them from healthcare workers and old people and ended up giving them away.

My point is, there's a wide range of scenarios between public health crisis and full-blown Mad Max. Not preparing for a specific one of these is preparing for none of them, and preparing for a specific one is not preparing for all the others.

jimmytucson··on Compuserve
Doesn’t look like it’s changed much in 20+ years, though I did find this quaint snapshot from 1996 of a team of engineers I presume with the caption “See you in the Spring!”: https://web.archive.org/web/19961220045225/https://www.compu...
jimmytucson··on Shanzhai
It’s funny how in the west, Shanzai can be perceived as deceitful - as in, you want me to believe these are “real” Nikes?! - whereas it’s meant as defiance against the artificially high prices brought about by marketing and consumerism.
jimmytucson··on UCLA floor tiles decoded, pay homage to first internet message (2013)
In case anyone else went to verify, note that the first character in the floor (01101100) is lowercase “l”, not the uppercase “L” (01001100) which was actually transmitted.
← PreviousPage 3 of 12Next →