The thing is, that potentially that causes problems for cash. As soon as technology is capable of tracking cash in the same way the same legal argument could be used. This is already relatively easy for electronic balances, but technology that tracks bank notes is quite easily imaginable.
I wonder what the case law for electronic cash balances is.
If someone uses a fraudulent credit card to buy something from you online, you're not going to be able to keep that money when the fraud's reversed.
If you (unknowingly) buy stolen property you can be forced to give it back, and then it's up to you to go after the guy who sold it to you. If you knowingly buy stolen property you're in trouble.
Given that BTC serial numbers are in plain view as opposed to stolen goods or dollar bills where you need a warrant, it's a lot easier to demand the BTC back.