Hacker News Reader

Comment by dmd | Hacker News Reader

Claude 3 Opus does a little better https://shot.3e.org/ss-20240310_141855.png but still doesn't get the interaction with the convertible.

View on HN

That's interesting just because it's such a perfect complement to GPT4's answer. Both models recognize that an unsafe situation exists and that immediate action is needed to avoid something bad happening.

I agree that Claude's answer is better from a purely-analytical standpoint. The only problem is, the car can still save itself (barely) but it's too late for the truck.

Neither is getting the bit that makes it a successful meme, which is that we understand what the truck's cargo is, and why it's important that the following car is a convertible, and what we imagine is thus going to happen.

It could just be a basic image-recognition failure due to the low-quality JPEG. I don't think Claude recognized the portable toilets, and I don't think GPT4 recognized the overpass.

If you ask it outright, "The truck in the image appears to be carrying portable toilets, also known as portable restrooms or porta-potties. These are commonly used at outdoor events, construction sites, and other locations where permanent restroom facilities are not available."

Using google lens with the tick marks on the image provide lots and lots of training examples that could work for that via simple pre-training and pattern matching.

In this specific image case there are even games on Baamboozle called "what is going to happen"

The answer is similar to the previous explanation.

I expect LLMs to be good at retrieval so it would be more interesting for images that weren't in the corpus.

That just depends on where your focus is. If the safety issue is much more salient, you’re not as prone to recognize the humorous aspect of the situation. If you see the image on a meme page, you’re already primed for comedy.

But here you are asking a different question, hinting to Claude that it is about the truck driving under the bridge. If you compare, ask the same question please.

When I ask the same question I actually got a much better answer! https://shot.3e.org/ss-20240310_145736.png

Wow!

Reply on news.ycombinator.com