Amazing, thanks for the reply, I'm finding some good resources afyer a quick search of `cl100k_base`.
If you have any other resources (for anything AI related) please share!
If you have any other resources (for anything AI related) please share!
Data files that contain vocabulary are listed here: https://github.com/openai/tiktoken/blob/9e79899bc248d5313c7d...