Atoms aren't really empty. They're electron clouds with an extremely dense core of protons and neutrons, but the electron clouds are what we care about.
To add a bit of a complication, if two particles that have mass, even one as tiny as the electron, come closer together than some minimum, general relativity predicts that they would collapse into a (really really tiny) black hole. Of course, we don't know how and if general relativity really works at this level, so the relevance of this is unclear.
You can even take it up a level and say that interaction events are the only things that really exist. That's more or less what Copenhagen QM boils down to. It is not at all a given that "particles" even exist between interactions.
Intuition insists that if something happens here and something apparently related happens over there and you can move here and there around to make a line or curve, then something physical is moving between here and there.
But actually - no. Not necessarily. All you have are ghost traces of an apparent chain of causality. And you can play with those traces experimentally to make them do incredibly weird shit in very surprising ways.