Definitely, but treating fen positions as tokens isn’t going to work, you need something smaller, something you can decompose into. What that is I don’t know.
Well, every character of the string can be a token. From a transformer's perspective it shouldn't matter if it is Chinese, English or "chess" language.