relevant note is that we finetuned by having the human also use arrow keys which keeps it in-distribution but also slower to collect