What you'll get is the same thing as GPT-3: the equivalent of googling the prompt. You can google "implement a scientific calculator" and get multiple tutorials right now.

You'll still need humans to make anything novel or interesting, and companies will still need to hire engineers to work on valuable problems that are unique to their business.

All of these transformers are essentially trained on "what's visible to google", which also defines the upper bound of their utility