I didn't realize that Spaces would finally allow for this! The public room directory is a horrible user experience today and really turns people off. I'm so glad that your team recognizes that too!
So is the idea that each Matrix server can have their own root Space that they direct people to? Kinda like an "instance timeline" in Mastodon?