Engineering management skills are very, very hard to evaluate. From what I'm aware of, you can get a general idea of someone's competence as an engineering manager by seeing how their engineers perform under them vs under someone else. For example, if a team is doing so-so, then a new EM comes in, and a few months later the same team is now suddenly all rockstar devs, this is a sign of a good EM.

Also, the best engineers aren't necessarily the best engineering managers. See https://en.wikipedia.org/wiki/Peter_principle.

We don't believe tech management interviews should at all be automated. You really want these to be as qualitative and human-driven as possible.