In democratic societies, in theory and largely in practice, crime is what society as a whole decided is a crime.

Bitcoin is indeed permissionless, which means you can use it for things society might find nefarious: tax evasion, drug trade, uncontrolled arms trade, human trafficking, money laundering, etc etc. You might not value that, but society as a whole does.