Maybe you should look at the code base before throwing a tantrum on a hacking blog.
Try adding a new feature to Tensorflow / PyTorch, do the same for TinyGrad and you won't have this question anymore.
Try adding a new feature to Tensorflow / PyTorch, do the same for TinyGrad and you won't have this question anymore.
Because I personally have tried, and found the code to be so code-golf and spaghetti-like that I gave up, it just wasn’t worth my time (even for the $1000 bounty).
The way to implement anything new and cool is to read it all first.
I love the way convolutions and matmuls are both expressed using ShapeTracker and simple mul operation for example. No other framework has that elegance.
Until you understand that part, it's not worth trying to change it.