I thought there was something in, like, Powerman10k or something, which managed to avoid that issue?
As for a replacement for oh-my-zsh itself, I had good experiences with zgen[1] but the fastest I've found is zim-fw[2] which produces acceptable start times for me[3].
[0] https://github.com/romkatv/powerlevel10k/
[1] https://github.com/tarjoilija/zgen