HNHacker News
TopNewBestAskShowJobs

thw20

1 karma · joined April 24, 2024

submissionscomments

Simple, zero overhead way to compress model, KV cache via Low-Rank Decomposition

jeffreywong20.github.io·1 pts·thw20·
0

Towards understanding multiple attention sinks in LLMs

github.com·1 pts·thw20·
2

The Existence and Behavior of Secondary Attention Sinks

arxiv.org·1 pts·thw20·
0