News for hackers. Stuff that matters.
Re:AI system self-organises to develop features of brains of... by saltwatercowboy on Friday November 24, 2023 @10:59AM (#38405226)
FFTs can be useful when constructing CNN pipelines in unsupervised domain adaptation too. Fourier domain adaptation (FDA) uses the calculated amplitude of a target set to modify the source (train) set. Cool and quick to implement.
Re:AI system self-organises to develop features of brains of... by dylan604 on Friday November 24, 2023 @11:45AM (#38405781)
I wonder how pleased Joseph Fourier would be seeing how his work has become so pivotal in a world probably unimaginable to his time. Not just for ego sake, but just how damn useful something one's effort did becomes to everyone else.
Re:AI system self-organises to develop features of brains of... by SpaceManNabs on Friday November 24, 2023 @11:53AM (#38405859)
I don't think it has to be the fourier transform necessarily.

I think the fourier transform might be a really approachable version because it is already in so much signal processing. Sometimes its periodicity can work against you.

From what I can tell you, what you need are:

1. invertible, identifiable basis

2. Something like Parseval's Identity

3. Able to "smooth" out things like the heaviside function or dirac deltas

4. Workable on graphs as well

5. decays at infinity

6. eigenfunctions are all orthonormal

Turns out, making something like that gets you something similar to the fourier transform, and the math is probably the simplest since you are working with easy exponentials that work nicely with convolution.

People have done similar work with Chebyshev polynomials, and there are actually a lot of applications in ML/AI using Chebyshev polynomials in graphical neural networks and triangulation.

edit:

The fourier transform also comes about pretty nicely in quantum mechanics because of poisson bracket stuff and its nice derivative properties for position-momentum space. I am don't think other transforms/function basis come out so naturally.

Re:AI system self-organises to develop features of brains of... by dylan604 on Friday November 24, 2023 @01:44PM (#38406846)
This is a great example why maths people can't carry on conversations with non-maths people. I'm sure everything you just said is very possibly true, but I have no idea. This would be like me asking ChatGPT a question, and it all sounds believable, but I have no way of checking if it is true.
Re:AI system self-organises to develop features of brains of... by kaba0 on Saturday November 25, 2023 @04:34PM (#38416899)
Why do you expect to understand an expert’s talk, without yourself being knowledgeable about the topic/subject? With all due respect, this cockyness is unfortunately quite common with software developers (myself included), as if being good at one thing automatically translates to a different domain.

Nobel disease, but even without the Nobel-price?

Re:AI system self-organises to develop features of brains of... by selimthegrim on Friday November 24, 2023 @07:07PM (#38409790)
Have you got some references on the Chebyshev applications?
Re:AI system self-organises to develop features of brains of... by SpaceManNabs on Saturday November 25, 2023 @02:12AM (#38411851)
Re:AI system self-organises to develop features of brains of... by SpaceManNabs on Saturday November 25, 2023 @12:57PM (#38415126)
Actually you dont need 5. just boundary conditions or decay.