There is nothing wrong with that approach if it accomplishes the goal faster, i.e. you can work at the speed of an AI.
Sure, and god knows I've done the same myself when under time pressure (so similar to an AI in RL training, just get the goal).
The part that's lacking (that humans are much better at right now) is the meta-cognition around this works, but it's far more complicated than it needs to be.
Potentially because LLMs have larger "working memory" than humans, they can avoid this for a while, but once it blows up the context they fail in much worse ways than a human would.
Hmmm, this feels like a good metaphor, I need to write about this at some point.