HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by quietFalcon | Hacker News Reader
Parent
Full thread
quietFalcon
·
[flagged]
View on HN
snehesht
·
They have some community benchmarks published
https://github.com/Niko1221/Strata/tree/main/bench/results
merbanan
·
Q2_0 does 33 tok/s decode and ~600t/s prompt processing at 128k context on RTX2060 8GB VRAM.
ISTA IQ3_XXS does ~21 tok/s decode and ~240t/s prompt processing
Reply on news.ycombinator.com