As I'm sure you know, group theory arose as a novel yet natural way of investigating the conditions under which polynomials can have closed-form solutions, and when Galois began to sniff this out it allowed him to get to grips with the impossibility of a closed-form solution to the general quintic polynomial: a problem which had beguiled mathematicians for centuries, solved by a theory which crystallised a more structural way of approaching abstract mathematics. Even though Galois theory is a relatively niche topic within the broad context of academia, for me it draws out the true character of group theory in a way that matrix groups don't, and neither do contrived examples formed from the natural numbers under various quotients. And it clearly solves a problem that required a new way of thinking.
There's certainly a balance to be struck here. If you fixate on historical origins then you aren't engaging with the reasons why the topic is still relevant today, so you risk missing the point. It also slows down the pace at which you can absorb the tools needed for applications. But if you only engage with the modern approach you risk building a disconnected, lifeless archipelago of knowledge, unable to see the beautiful links that unify so much of mathematics.