Controlling your own crypto keys is like having your net worth in cash or gold stored in your house. It could easily be lost or stolen or destroyed in a fire unless you take extraordinary precautions and then it is all gone.
This falls under "extraordinary precautions" that few people do and is an enormous error prone hassle.