That's a naive approach. If you're in a place where people are fanatically devoted to the mission, it's a benefit in it of itself.
First you'll learn a lot. Residency is often grueling in terms of hours. The payout is much later as you learn more.
Also you're surrounded by very smart hard working people. Every high achiever I know hates working with low achievers or people who are lazy, incompetent or don't care. This is selection. So you learn a lot, in a very intense way, you'll learn a lot from smart people in a very short period of time.
But the most important thing I learned is that there is a huge universe of knowledge you can't learn from books or derive logically. You would learn more doing 996 following around a high performer over a short period of time than you would from years of school.
Some people like doing hard things. People do Ironmans and marathons, they train months for them and what do they get in return? Some endurance and strength that will dissipate within months of the end.
Finally it depends on your stage in life. If you're coming out of college, I would definitely recommend doing the most challenging thing you can find in your area of interest. If you have a family and kids, maybe pull back a bit.