Fast Bing Tokenizer for BERT

blogs.bing.com

7 pointscatam3 comments

Super fast BERT tokenizer. It will save you 100x time in preprocessing text.

Mainly it will help improve latency at inference time. For preprocessing training one can always add more threads, but not at inference time.

State of the art performance for BERT :-)