It sounds very much like a very specific joke.
Blues Brothers has a scene where Belushi is being obnoxious and asks the father in family of diners at a neighboring table "How much for the little girl? How much for the women?"
Of course, the joke there is precisely that it's so outrageous and unacceptable.
Though I certainly wouldn't say everyone (or even most) need to find it funny to "sound like a joke" in the sense you meant. Surely, there are bad jokes that sound like bad jokes. I think it's probably correct to say that most should "immediately know it is a joke".
All of that said, whether that's likely to be the case in this instance depends on a lot of context that wasn't specified.
So if that guy was non-dork normal looking (read: able to defend himself) you wouldn't punch him in the face? Everyone likes to beat up imaginary nerds, but what if it was the Charles Atlas kick-sand-in-the-face kind of guy, huh?