Running Neural Amp Modeler on embedded hardware
tone3000.com
tone3000.com
That's cool, but I'm curious about the whole virtual pedalboard thing to make it all more affordable, adaptable, and easier to change between setups while playing live.
Here is a project that seems to do a pretty good job at creating a UI for all this virtual pedal stuff... https://rerdavies.github.io/pipedal/
I've only dabbled with it a bit. I'm still trying to figure out good robust hardware setup for this that works for how I play shows.
It is obviously not possible to run huge LLMs in realtime; but it's been known for some time that very small neural network ML models can run in realtime, and can produce absolutely stunning simulations of real amps. The models are typically in the order of thousands of weights, not billions of weights. (Not actually sure what the weight count is for the A2 pico models that are being discussed in the original post. OP may be able to help with that).
These tiny neural network models not only accurately reproduce the sound of the original amps, but also manage to reproduce the feel of playing the original amp as well. The quality is dramatically better than most previous amp simulations (and entirely competitive with really high-end amp simulation technologies like Kemperer). It is breakthrough technology, for guitar pedals and amp simulators particularly, that literally changes everything in the music industry. The models are also relatively easy to train. TONE3000.com provides free online services for training models, and currently host a massive library of thousands of high-quality NAM models that are downloadable, free of charge.
The particularly interesting part of this report is that a single NAM model will be able to run on ridiculously tiny embedded processors. OP claims to have a 2nd-generation Pico NAM model running on a 500Mhz Cortex M7. First-generation Standard NAM models typically require a much more beefy processor: an ARM processor in the Pi 4 or Pi 5 sort of range (2.0Ghz Cortex A72, and 2.4Ghz Cortex A76 processors), or on x64 processors (an N100-class intel processor would be a good choice).
(Author of an open source project that uses Neural Amp Modeler Core technology to run NAM models on Raspberry Pis)
To model amplifiers and effects, you would have to do non-linear deconvolution and re-convolution, which is pretty compute intensive, and pretty challenging to do in realtime. There are a couple of well-known algorithms for doing this; but I'm not aware of anyone that can do it in realtime.