HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by hexomancer | Hacker News Reader
Parent
Full thread
hexomancer
·
Mixtral is also a MoE model, hence the name:
mix
tral.
View on HN
sangnoir
·
Despite both being MoEs, thr architectures are different. DBRX has double the number of experts in the pool (16 vs 8 for Mixtral), and doubles the active experts (4 vs 2)
Reply on news.ycombinator.com