Of course you can, to varying degrees. The farther from cities and the more resourceful you are, the more separate you can get.
> The people in question want to refuse vaccination but still participate fully in society, which is not how a societal contract works.
You only wish there was such a contract, but there is no such thing. Even in cities, being part of a free society does not mean or require submitting to any medical procedure.
> the consequences are fully externalized onto those who are unable to be vaccinated.
Not getting vaccinated does not imply, legally or physically, that you intentionally spread disease. You are jumping to false conclusions.