Never-mind that passports tend to be expensive (relatively speaking, for the average person), many countries don’t issue passports for a variety of reasons: the UK will refuse to issue - or confiscate - passports of football hooligans specifically - or suspected terror-tourists, I’m sure other democracies have similar policies, let alone more authoritarian regimes.