I second your notion that being athletic is not a requirement: the actually fit I’ve met are all extremely calm, accepting and disciplined. In the right gym/club/group, it’s an extremely rewarding experience for any body type and fitness goal. Be aware that distance based cardio groups (running, biking) will often require fitness that is above average but there are exceptions (look up a parkrun near you).