This is an interesting theory of law, but I could go quite a way naming crimes that don't result in physical harm. Fraud, theft, harassment, threatening physical harm, rape, slander, kidnapping, slavery, forgery, theft of military plans, obstruction of justice, treason, drugging someone, criminal negligence, impersonating a surgeon, arson, blackmail, trafficking in stolen property, child abduction, and basically attempted anything, including attempted murder, conspiracy to commit murder, incitement to murder, and solicitation of murder.
Setting aside your novel legal theories, you apparently don't believe harassment, stalking, rape threats, and death threats cause real harm. But neither victims nor perpetrators agree with you: often the explicitly stated purpose is to cause harm.
The "just ignore the trolls" position is fine advice for a very specific sort of troll, the ones that are motivated by attention. But for the ones who are motivated by harm, it doesn't work. Indeed, it helps them operate by giving them cover.