30 cents per million tokens is wild.
The relevant question is how easy is to setup 56x B200s in a cluster, are we talking about a adhoc infra team job or clicking a button on AWS?
The relevant question is how easy is to setup 56x B200s in a cluster, are we talking about a adhoc infra team job or clicking a button on AWS?
Regarding model quality GLM 5.3 is past the good enough bar for most coding tasks. I wouldn't be surprised if the limiting adoption by companies is price not frontier model quality for most of their tasks.
Besides that, since this is a bank, you can see how significant the requirements are to run sensitive workflows within your own infrastructure premises.