Eh I had some issues with microsoft's "guidance", eventually got it working with an older version. They haven't updated it in a month too.
lmql might be a decent alternative.
Any form of logit bias should work though.
lmql might be a decent alternative.
Any form of logit bias should work though.
No comments yet.