Engineer creates CPU from scratch in two weeks, begins work on GPUs
tomshardware.com
tomshardware.com
>If you check the twitter thread, he didn't create a CPU, or anything close to one. As far as I can tell, he just took some circuits that others created (e.g., debouncer, pwm) and hooked them up to create a 3 channel LED controller that can output a pulse signal. That's it. He did go through the rest of the flow (synthesis, STA, P&R, etc.) but it seems to be the core only, there's no pads or anything to connect the chip to a package, it's just the core logic.
His complaints about the inability to find any details on GPU architectures strikes me as weird because there's a wealth of information about it out there, especially if (as he clarifies in later posts in his thread) you're ignoring the fixed function and graphics aspects of a GPU and just making it GPGPU, at which point the architecture is largely "high-way SMT in-order CPU architecture with SIMD execution units"--nothing out of the ordinary in any advanced computer architecture course.
Interestingly, Anthropic’s Claude Opus AI tools have been useful during this GPU designing stage. “I've been proposing my ideas for how each unit must work to Claude, and then somehow it will guide me toward the right implementation approaches which I can then go and confirm with open-source repos,” explained the engineer.
"Please don't post shallow dismissals, especially of other people's work. A good critical comment teaches us something."
I think it did. I am very rarely just snarky and I certainly wasn't in this case.
From other comments though I’m not sure it’s even that?
I can’t tell because twitter makes it hard to read threads now and I can’t tell if details are missing from the article, or literally there nothing to actually report on?
Also the comments on GPUs is really confusing? It sounds like someone has bought into the mythology of GPUs being somehow magic, rather than simply many parallel micro-micro processors.
https://www.tomshardware.com/author/mark-tyson
That's like 2 articles a day. I can't imagine. I spend at least 10 weeks on each one I write.
To be clear: I think that a decently motivated person can go from "0 knowledge" to a toy implementation of a CPU in a digital logic simulator in something like 20 hours of focus or so (especially if the digital logic simulator gives you prebuilt components for things like adders and memory). I've never done digital design for circuits before, but I imagine it's a similar level of difficulty.
From parsing the Twitter user's comments, the GPU confusion seems to be the Twitter user skipping any attempt to learn advanced computer architecture because he thinks it's not on the critical path to building a GPU and doesn't realize that the information he's struggling to find is really just computer architecture 301.
His YouTube channel has some excellent videos guiding the process: https://www.youtube.com/beneater
If you'd like to build a CPU from scratch, I would suggest https://monster6502.com/
If you want to get really fancy, build the Monster 6502 and then use that as the CPU in your Ben Eater 6502 kit!
It's kind of a similar situation to JavaScript actually. And in a similar way, you can compile to Verilog, but just like with JS it makes debugging much more painful.
There was this interesting project but it seems inactive: https://llhd.io/
There's also various alternative HDLs that seem to have various levels of solving the wrong problem (SpinalHDL, MyHDL, Chisel). This one looks quite interesting though: https://filamenthdl.com/
This is like the guy on Twitter who threw MRI scans at Claude.
Or Juicero.