HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by g023 | Hacker News Reader
1 point
·
g023
·
·
1 comment
View on HN
g023
(original poster)
·
A self-contained CUDA inference engine for LiquidAI/LFM2.5-8B-A1B (hybrid conv + GQA-attention MoE, 8.5B params, 1B active) targeting a single RTX 3060 (12 GB) using flash-decoding. MIT license.
Reply on news.ycombinator.com