HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by famouswaffles | Hacker News Reader
Parent
Full thread
famouswaffles
·
MoE models don't work like that though
View on HN
SgtBastard
·
Token-at-time MoE models could result in mid-output-stream directional change.
I agree with you that whole-output MoE models don’t.
Reply on news.ycombinator.com