Yeah this is an interesting talk. A full DAW is maybe over ambitious for one developer, but I don’t think vst plugins would be able to achieve what I wanted.
For example vsts can easily spatialise individual sounds, but there is no way to then easily move the listening position through the scene, without a disgusting amount of automation - hence building a virtual 3d environment daw with more placement flexibility
... or start with an open source DAW that already has all the rest, and add the placement flexibility you want ...
But I'm speaking out of self-interest here, and anyway for now your output is limited to binaural stereo which is not really a viable target for production workflows at this point.