I have the RX100 M5, and I love it[1]. I
can fit it in my pocket if I'm wearing loose pants, but the lens sticks out 1 cm from the body and it's just a little bit too bulky to be comfortable, even in a jacket pocket.
But I got a neck strap for it, and the camera is light enough that I can barely tell it's there. That's how I'll use it on a hiking trip, and sometimes I'll even take photos by looking down at the flip-up screen.
[1] I don't love the menu-driven UI though, or the digital lens ring control. But however much of a compromise the pop-up digital viewfinder is, it works great in bright sunlight when the screen gets washed out, or when I need to hold the camera close to me for a steady shot.