Group cohesion's hard, and a lot of the techniques for creating and maintaining it are considered distasteful or seem really damn cult-like (because they are). That'd be my guess. Aside from logistical concerns or whatever.

Conflict with other non-nomadic groups they come in contact with. The Romany might be a modern take on nomadic people. They don't tend to be welcomed when they arrive at/near a town.