Oh, it's way more interesting than that. Each dimension is linear. Any two dimensions form a grid. There are infinitely many orthogonal directions along which you can go an arbitrary distance.
In the complete graph, any two points are equidistant. It's rather boring.
Also, (and you probably couldn't pay a physicist to care about this, but) you can have an infinite complete graph, with countably infinite nodes and edges. The infinite dimensional grid, on the other hand, has uncountably infinite nodes and edges even if the dimensions are countably infinite.