Frontier Pre-Training at Microsoft AI

Microsoft should stop tormenting developers and fix text input in MS Teams, then go and atone for its many, many sins, before committing new ones, like this “this not really an open weights model but we want to IE6-them with our bully tactics”.

> Microsoft should stop tormenting developers and fix text input in MS Teams

This is very hard. Win 11 has become "secure" . The copied text might or might not be in the clipboard, depending on "security". When you enter the password, just make sure that the password prompt is visible or else your keystrokes might be lost. Today i had to restart Win 11 because its graphics driver was confused and forgot to redraw some window elements in random programs after unlock.

Wait, I don't get it. Is the model not open? If not, why are they comparing it to Open Weight models instead of the state of the art?

Because SOTA Closed Base Models are not available to compare to.

Very similar to Kimi K3 it seems, but fewer active params (80b vs 104b). I don't think they mentioned what form of attention they use