They were allowing $100,000 per month per employee?!
That's incredible. Just a few years ago that would have been zero.
We're working on bringing the last 10% down by giving non-developers various AI skills such as a compliance module that can be pushed to specific Entra groups which will make sure their vibe code madness will stick to external dependencies we've approved. (There are still hard checks later).
For other tasks it's running on guesses, and sometimes you can save help people €1000 a week by teaching them how to use the AI better.
The question is does it scale properly? Answer: it depends.
What is the value of a project going from six months to six hours? You can look at saving the man hours but how long can that go?
What about a project that takes $100k in tokens and generates $200MM? The difficult part is determining how much was AI is the multiplier.
We are finding both to be true while quantifying requires new accounting.
However, that's very different from building and maintaining a product that will be used for live customers, where you have to consider security implications. This is what we're talking about here for Meta and Microsoft, and it's what I do for my actual coding job.
There is a level of trust on the model, the harnesses, and the operators that is required to move quickly.
To build that trust we are building systems and processes and getting the mindset that trust is the speed limit.
Then they tightened it down again and again. Right now, it's at $2k/month or $24k/year and the model restrictions are and to go wider.
Still, most employees are not hitting the limit but enough are that there's an exception process