We had a course like that and I absolutely loved it. It's the most fun I've ever had in an educational setting.

It followed such a lovely flow, starting with the absolute lowest level of computing (binary maths, diodes, transistors, and building logic gates with these) and kept on combining these building blocks until we arrived at modern computers and software.

Even if you're just a "modern age" developer that only ever uses modern programming languages, just understanding how everything is built makes you make better decisions all around.