https://www.fsynth.com is a web synthesizer which is just doing that, a canvas content is generated by the GPU and converted to sounds in real-time, there will be a feature to import sounds directly soon.
Presumably.
That might be the a better way of doing things actually, since visual tools are 2-dimensional by nature.