114 karma · joined August 12, 2011
Also implemented this as a gh action, works well for sentry to gh to auto triage to fix pr.
Can you release slightly bigger quant versions? Would enjoy something that runs well on 8x32 v100 and 8x80 A100.
fast-draft.ai
Please, please send me an email or dm if you are interested.
lora does not work though, you need full parameter training if the knowledge isnt already present in pre training set.
Any exception made to this checklist is reviewed by third parties that couldn't care less, bean counters, or those technically incapable of understanding the nuance, leaving only the large providers able to compete on the playing field they manufactured.
Deepmind published something similar recently for claim validation and hallucination management and got excellent results.