I remember when most of my work came down to how to deal with the 512 token window of BERT.