Hacker News Reader

Anyone know if a MoE model that can run on a gpu with 16GB VRAM (like 3.6-35B-A3B) is in the pipeline as well, or only the dense 27B one?

Whoever runs their Twitter wouldn't confirm / promise anything beyond 27B, but didn't say no either. So maybe in a month, maybe not.