I kept my Olympus XA in my baggy jeans pocket almost all the time.
To Americans, the Japanese taking snapshots at every opportunity (including business meetings--OK we mostly don't do that) was notably odd behavior. Today, I'm sure just about any random nationality takes far more.
I have lots of dedicated camera equipment but most of that is for event, travel, or dedicated photography of some sort. If I know I'm going to be on a trip where I'm going to just be taking random memory pictures, I mostly just bring my phone.
The FUJIFILM X100 probably comes closest to rangefinder translated to digital with a fixed lens. But a bit bigger again. And it's IMO a whole lot of money for a specialized camera.