Don't you see it? That's exactly what "AI" in this context is.
It's the bypass.
Where does it end, eh? Build a quantum "AI" that will end up just needing more data, more input. The end goal must starts looking like creating an entirely new universe, a complete clone of everything we have here so it can run all the necessary computations and we can... ? (You are what a quantum AI looks like as it bumbles through the infinitude of calculable parameters on its way to the ultimate answer)
But spoilers: DNA will be fine, meat machines maybe not so much...
For a bunch of people addicted to the works of Charlie Stross, Neil Stephenson, and Iain Banks, y'all are a bunch of luddites. Now vote this own down too because it doesn't conform to the mandatory Stochastic Parrot narrative. You have no free will and you must downvote after all. Why do you even read their works when any step towards their world is consistently greeted as the worst thing evah(tm)? What? You were expecting the United Federation of Planets without the eugenics and nuclear wars that led to it finally being a good idea? Bless your hearts.
And if you're worried about billionaires and tyrants, start taxing the former and stop electing the latter or STFU and let the free Markov process of history play itself out. Quoting fictional Ambassador Kosh: the avalanche has started, it's too late for the pebbles to vote.
You asked where it ends. Don't ask questions if you don't like answers. Quick reminder: shun and downvote the non-conforming opinion.
> metabolically expensive meat machines
Calm down. There is no meat. It's just a giant sponge of wave packets.
Your take is the most S.V. conformist one there is: materialist reductionism, and it is doomed.
Tell me you don't understand hitchhikers guide without telling me you don't understand hitchhikers guide. This is as bad as Thiel and ilk's inverted reading of LOTR.
From my perspective, the most SV-aligned mindset is to run around in circles screaming that AI will destroy jobs to give the military/industrial complex cover to commit atrocities with Palantir and for tech billionaires to run wild with surveillance capitalism, but I know, silly me!
Same mindset that demanded safe spaces in schools over actually safe schools. And I don't really want to this caustic and sarcastic on the subject, but both the radically pro AI and radically anti AI factions, who both scream the loudest, really bring out my inner Marvin. The future is coming whether you want it or not. The question is how you will steer it. Get in its way and you'll just get steamrolled.