I did something similar, but with an end-to-end ML approach: https://towardsdatascience.com/transcribe-live-chess-with-ma...