If you completely ignore deaths for a moment, many report severe negative symptoms, lasting weeks or more, resulting from dehydration or overheating from MDMA. Overheating is also speculated by many researchers to be responsible for some of MDMA's neurodegenerative and neurotoxic effects.
You probably won't die due to MDMA, but if you're not careful you can certainly cause brain issues. And that makes it more physically dangerous than cannabis.