That's very tempting, but you lose a lot if you do that, especially around text:
* Accessibility for screen readers, etc.
* The easy ability to select text, copy/paste between other apps, etc.
* Line splitting
* Support for multiple languages, RTL, and all their other rendering quirks.
Canvas has some text APIs, but they are fairly rudimentary. It's a hard problem.