HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by vlovich123 | Hacker News Reader
Parent
Full thread
vlovich123
·
What’s iSWA? Can’t find any reference online
View on HN
imtringued
·
Gemma 3 has some layers with a context size of 1024 tokens and others having full length. You need to read the Gemma technical report.
nolist_policy
·
interleaved sliding window attention
Reply on news.ycombinator.com