Love the idea.
How exactly do you validate experts? Are you just going by merged PRs (this might be somewhat exploitable though minor PRs, if you're successful I'd assume)? I imagine checking for the quality of PRs would be way too time-consuming to do manually... Do you consult the maintainers of a repo?