News for hackers. Stuff that matters.
Re:Nam: Neural Amp Modeler by ofalkaed on Monday April 10, 2023 @02:05AM (#35509604)
You understand correctly. All of the amp modeling and virtual analog stuff is still fairly limited and they largely focus on getting the stereotypical sounds of the source, not the full range. Modeling things more fully is not difficult but it is very processor intensive, many spice programs can do it quite well but are far from real time. So simple analog amp modelers like the sans-amp offerings still out perform the digital emulations in some ways, they might not be as accurate but they tend to be more versatile, which is best depends on what you are after.

I have been on again off again doing a fairly intensive write up on this topic going into all the technical details (primarily the hardware side) complete with a fairly full featured/accurate digital recreation of the original MiniMoog VCF in PureData but it is not exactly a priority and progress on that is rather slow.

Re:Nam: Neural Amp Modeler by Archit3ch on Monday April 10, 2023 @08:43AM (#35511601)
> I have been on again off again doing a fairly intensive write up on this topic going into all the technical details (primarily the hardware side) complete with a fairly full featured/accurate digital recreation of the original MiniMoog VCF in PureData but it is not exactly a priority and progress on that is rather slow.

I'd be very interested to see your approach. So far, the most promising (non-NN) technique I've seen requires taking a symbolic inverse of a sparse matrix, which is just barely possible for a simplified pedal model.

Re:Nam: Neural Amp Modeler by ofalkaed on Monday April 10, 2023 @02:37PM (#35515736)
I am doing things in just about the most idiotic and inefficient way, break the circuit down into easy to emulate blocks then emulating how they interact by adding in stuff which mimics that interaction.

The purpose of this exercise is to illustrate why it is so difficult to effectively emulate these circuits and this does it quite well and in a way most anyone can understand. So to show how the output stage loads the filter's core and affects frequency response, distortion, and gain of both the filter and the output stage I add in filtering, distortion and variable gain between them and go through the work getting them to respond as they do in the filter. Then go on to show how the resonance and cutoff affect this which is rather circular and further complicates getting that added bit of circuitry to respond proper and how everything affects everything else, nothing is in isolation.

So I slowly make up a big massive mess of a patch in PureData that eats my entire CPU but does a fairly solid job of the emulation then try and simplify things down. Along the way we compare our progress with the various digital implementations of the filter and probably will compare with the real deal.

Re:Nam: Neural Amp Modeler by Archit3ch on Tuesday April 11, 2023 @05:26PM (#35531809)
> The starting point is essentially the classic simple moog model with some extra stuff and I add in bits between those blocks to mimic the interactions while comparing it to various digital models of the filter, spice simulations and the real deal.

Yup, there are two main philosophies: start from a very accurate (e.g. SPICE) model and simplify it enough that it runs in real-time or start from a simple model (e.g. biquad) and add nonlinearities as required.

If you want talk more about the other approach, I just added an email in my profile. ;)

Re:Nam: Neural Amp Modeler by ofalkaed on Wednesday April 12, 2023 @05:23PM (#35547171)
The problem is that everyone implements those nonlinearities as isolated and largely static things, which they are not, they are dynamic and interact in complex ways. From what I can tell the vast majority of people who implement these models don't seem to really understand the analog world, they model the circuit in spice and run a simulation at a static setting with a single source and call it good, this kills the dynamics which are a fairly important part of the sound. This is also why many amp modelers are often said to do the high gain or clean sounds well but fail in some vague way on everything else, the simplified dynamics used for modeling are close enough to reality for those sounds.

The mini VCF is not the best option for my needs but it is useful in that I have a good many implementations to use as controls as the patch advances and I can show why it all matters well enough, I can provide musical examples which most anyone will be able to hear the differences between. Ultimately I think the software folks are making the wrong sacrifices which is why pedals like the Sans-Amp series and even the somewhat naive Run Off Groove [0] DIY offerings maintain a solid following despite not sounding much like the amps they attempt to mimic, they do respond like the amps, they maintain the dynamics or at least something close enough.

I am not sure we will have much to talk about but I will give you an email when I am back on the computer.

0) https://runoffgroove.com

Re:Nam: Neural Amp Modeler by wintermutestwin on Monday April 10, 2023 @09:23AM (#35511962)
>All of the amp modeling and virtual analog stuff is still fairly limited and they largely focus on getting the stereotypical sounds of the source, not the full range.

Except for Fractal, which models based on the component level.

Re:Nam: Neural Amp Modeler by ofalkaed on Monday April 10, 2023 @02:39PM (#35515757)
A very simplified version of the component level. Component level is very good but not real time unless you sacrifice a fair amount. Ultimately it is a bit of a wash between other methods, just shifts were it fails and where it succeeds to somewhere else.
Re:Nam: Neural Amp Modeler by intalentive on Monday April 10, 2023 @09:52AM (#35512293)
You can build a neural network model of the whole device, but you have to collect a lot more data. Results depend on the number of parameter permutations you sample and on the independence of the controls. I trained a NN on an expensive analog EQ with millions of permutations, but because the controls are largely linear and independent, it can extrapolate well to unseen combinations.

You can also use differentiable DSP to obtain a decent “first pass” approximation using traditional methods, and then rely on the NN to make up the difference afterward. This dramatically reduces the NN parameter count and speeds up computation. I recently tried this on an analog compressor (LA2A) and got 95%+ of the way there with a very small model.

Re:Nam: Neural Amp Modeler by ofalkaed on Monday April 10, 2023 @02:19PM (#35515480)
Sure, but you still have an infinite number of possible inputs, your model will only show that on certain note combinations at just the right volumes you get sub harmonics through intermodulation distortion if you find those note combinations when you build it. Musicians are very good at finding and exploiting these quirks of equipment, they are what ultimately define the characteristic sound of given bits of gear (and the musician's) and are what companies in the modeling business aim for, they get a dozen or so of those characteristic sounds and fudge the rest through a mix of techniques like interpolaitng the difference. But you can not get them all and the only people who end up buying the tech are the ones that primarily want those stereotypical sounds and that is getting to be a very crowded market.

If someone really wanted to use such technologies to be a game changer they would forget about the past and use it to design something new that exploits its strengths in a way that is natural to the musician instead of showing off its weaknesses. The potential of the technology is quite amazing and yet everyone uses it to chase nostalgia.