Recent paper highlights the difficulty of creating a new optimizer as drop-in replacement. Sophia and Lion were recently proposed as superior alternatives to Adam, but appeared worse in an independent eval
126 karma · joined November 17, 2022
What will be any guess?
But there is no credit for you on this website. How can we know you created this?