You switch it off by putting it somewhere dark or flat (in your pocket, bag or on a table). If there was an on/off switch and you switched it off before going into a dressing room or similar setting where it's inappropriate to take photos, other people will still be uncomfortable. By making the the on/off switch equal to taking the camera off, we make people more comfortable with the concept of a wearable camera.
A similar line of though went into design of the camera itself. We made sure through user testing that most people recognizes it as being a camera, and not as something else. But also that it is subtle enough to not be distracting. It was a fine balance to find between the two, but with the current design most people find it appealing.