Where it's rewarding is taking available drivers and building a full speaker around them -- usually optimizing for performance vs cost. It's difficult and expensive to build really high quality loudspeakers. Add markup to that and the retail price of a well engineered speaker will quickly go into 5 digits.
The speakers in my living room are DIY (though they don't really look "DIY" as far as that might carry negative connotations) and they're an excellent value. They were also fun to build. In no way was I disappointed afterwards because I had not, say, wound the voice coils myself.
For a brief time, I had a pair of speakers on my desk made from old PC case speakers that I salvaged and just put on stands made from blocks of wood with a hole in them. I liked the look, and the sound was alright, but rather weak and tinny. Then one day I decided to build a box around them, and the difference was night and day - much louder sound with significantly more bass.
There is a big difference between just making a box, making a box that looks nice, and making a box that cooperates with the specs of the driver to make a good speaker.
You might be surprised how awful the specs are for a bare driver hanging by its wires in the air without an enclosure. It is very much like the analogy of a musical instrument reed.
I for one would have loved to do this kind of activity as a kid: it's a pretty simple concept that puts a whole lot of power in your hands and exposes interesting questions. It looks like Bose is doing something in this space at kids science camps [0]. If you can acquire/make an amp and a strobe light to replace their "blue box", there's a whole host of kid-friendly activities on the site to do with kids centered around making hand-made, origami paper drivers.