It’s not being forced to work - the option to quit remains.

Consider a case in which a majority of society excludes a minority from most commerce. Are ghettos, ‘separate but equal,’ and whites-only fountains not worth preventing?