Magit is plenty fast for me personally. Near instant even. As for UI stuff, I'm not sure what you mean — it does have a file tree sidebar minor mode, and it can display images and tables and so on in Markdown or Org
yes things like the tree sidebar, i think those UI element can be improved, again magit can be used for benchmark, this can improve the log viewer make it look nicer