HNHacker News
TopNewBestAskShowJobs

pitpatagain

375 karma · joined October 28, 2024

submissionscomments
pitpatagain··on State-space models can learn in-context by gradient descent
It adds a very local sliding window attention, the context is only 3 adjacent frames per step. They need the access to adjacent frames to show the implicit model gradient computation but I didn't yet follow the derivation for why this is so.
← PreviousPage 3 of 3