254 karma · joined October 9, 2020
But as an engineer I just nerd out over all of it. Analog. Digital. If it makes good music it’s all cool to me.
It can’t do time based effects such as delay, reverb, flange, chorus, etc. The LSTM can model distortion, overdrive, compression to an extent, and amp circuits (including vacuum tubes).
As the creator of this project I can assure you that the audio used here is at least CD quality (44.1kHz 16bit). With the HiFiBerry hat the digital audio comes in at 24bit/192kHz. The NeuralPi DSP processes the audio at 44.1kHz with 32 bit floating point precision. No reason the sample rate can’t be higher though. Elk OS claims latency is less than 1ms, but I’d like to test and see exactly what the latency is running the plugin. As a guitarist, I can’t tell the difference between this and an analog effect.
runs and ducks for cover
No, the training is not accomplished on the Raspberry Pi, I used Google Colab, which has GPU runtimes. I had similar training times with local GPU. I haven't tried it yet, but I suspect any practical training will take too long on the Pi. I'll probably look into recording samples with the Pi/HiFiBerry hat, and then upload the samples to another computer (or the cloud/Google Colab), and then send the trained model back to the Pi. I believe I'll be able to automate that process at some point.
The purpose of this project is to improve on the previous WaveNet model built for the same task. Using LSTM is orders of magnitude faster and more accurate for emulating guitar signals than WaveNet. A real time guitar plugin exists for the WaveNet implementation, and a plugin for this the LSTM model is currently in work. Compare to Neural DSP’s Quad Cortex neural capture feature, which uses a similar technique on their $1600 floor modeler.
What I'm really aiming to do in the long run is to get other musicians and machine learning enthusiasts to train and share models that will work with these plugins for a variety of hardware. It's very much a new technology to me and I'd like to figure out what all it can do.
Considering this project sat for a month with no stars and after this post (and one hour) it jumped to 134 stars, not discouraged at all!
Thanks!
But yes all good points and further proves that more money does not mean better sound.