Have you looked at just using IFC? It’s the canonical “building as a graph” BIM format. Whether the in memory IFC allows querying I suppose is up to the implementation, I have only used xbim https://github.com/xBimTeam