The issue is that there just isn't that much data. You collect a bunch of macro level time series variables. Ok now what? No matter how cool or sophisticated your model is, there is just too little data to tell which models actually fit reality.
The criticism I describe is what most economists tell me when I bring up agent based models. In practice they mostly just ignore the field.