Sorry, but is this a joke?
Yes, in that context it's offensive, I agree. But when people use that as a slur with something without a learning disability they aren't literally talking about or referring to a learning disability so it's a different context