The S4 has the huge advantages of having an SDcard slot (up to 64GB) and a replaceable battery. The HTC One has neither. I wonder how much of the internal flash on the HTC One is available.
The argument of the 16GB model not having a lot of internal flash space is pretty weak when you can get a 32GB SDcard for $20 (or less).
The HCT One does feel kind of nice with its weight and aluminum body, but I'm not sure it would do any better than the S4 in a drop test.
Speaking of drop tests, I've replaced the digitize on my Nexus One twice now, because I like to drop it. The S4 is difficult to replace the front glass, but it is not impossible. I do not know how the HTC One fairs in repairability.
On the CPU side, the S4 is faster, but they are the same CPU in both units as far as I know.
The HTC has a better screen color profile, and the camera does much better low-light/night shots. I have heard the the S4 camera does not do well in low-light conditions, which is really shameful.
HTC has a deal going on right now where they will give you a $100 debit card rebate. That could turn the tide in their direction if you are buying on price alone.
The top concern I have, though, is modability and community support, since I know that neither HTC nor Samsung will support that device once they have my money. I will immediately root it and install something like Cyanogen.
Both phones will likely have pretty good support from the Cyanogenmod project, but I am going to wait until the end of May and then go see what the community says. Whichever hardware has better support in the Cyanogen community will be the one I buy.