Everything hurts others. People and their actions don't exist in a vacuum - we are all players on a team called "society"; the actions of people, even if done privately, can end up affecting the performance of the team. Cars, alcohol, and tobacco are all legal, and all of those things end up harming others directly or through second/third order effects.
I'm not necessarily against decriminalizing or even legalizing marijuana, but I don't think the reason for doing so should be because it "doesn't hurt others", but rather because governments should infringe on liberties as little as possible even if it means bad consequences could emerge from abuse of said liberties.