You can still make a device with easily replaceable batteries water resistant (or even water proof), but it's easier (read: less bulky) to do it with a non-replaceable battery.

Compactness is definitely a major tradeoff though.