The handwriting recognition was the Newton's oversold aspect, leading to (in my opinion) many to overlook some unique system-wide architecture decisions for data representation; the data soup [1].
That technical description doesn't easily convey the benefits for those who have never seen data soups before, but this blog post [2] gives some idea.
[1] https://en.wikipedia.org/wiki/Soup_%28Apple%29
[2] https://blog.mozilla.org/faaborg/2007/06/29/why-the-iphone-i...