I switched from ansi-term to vterm (https://github.com/akermu/emacs-libvterm) and its performance is much better (specially when dealing with large bursts of output).