Sony is still making modern variants of the Walkman. I'm not a big fan of their Android powered versions, but I like the slightly earlier versions that can only play music.
I have a Sony NW-A45, but there's a few models in the NW-A line-up that are attention worthy.
I also prefer single purpose devices for retro gaming and taking photos.