News for hackers. Stuff that matters.
Re:Towards a Physics Foundation Model by flwi on Thursday September 18, 2025 @01:43AM (#45285887)
Author here,

Wow, I didn't think this would HN. I actually planned to do the advertisement rounds only after the final ICLR submission.

This is our attempt at creating a model which understands multiple physics, which is in contrast to PINNs and Neural Operators, which focus on much more narrow systems.

Obviously, the biggest issue is still data (3D and real-world problems), but I think we and a few other groups make significant progress here.

Re:Towards a Physics Foundation Model by IronyMan100 on Thursday September 18, 2025 @07:53AM (#45288513)
Some month ago i stumbled upon two arcticles discussing PINNs and their failiures in more complex settings. are there similar challenges?
Re:Towards a Physics Foundation Model by flwi on Friday September 19, 2025 @01:22AM (#45298221)
Can you point me to the papers? In general, faster dynamics and chaotic systems are probably the hardest. Of course combined with long-term stability
Re:Towards a Physics Foundation Model by lindboe on Thursday September 18, 2025 @08:17AM (#45288691)
Great paper!

Off the top of your head, are you aware of any similar general-multiphysics NN work that's been applied to electromagnetics problems? In particular, some colleagues in my lab are investigating imaging via acoustic waves which are induced by microwave absorptive heating (in liquids, biological tissues, etc.); this approach is most commonly known as RF-induced thermoacoustic imaging [1]. It's very tricky to model this phenomenon in simulation, doubly so to measure it experimentally.

Most in my lab (myself included) are leery of throwing NNs at problems and seeing what sticks, but sometimes I wonder whether a model like yours might help us skip past the boring details to get at the novel technical stuff, or else extend simulations to more complicated boundary conditions.

[1] https://ieeexplore.ieee.org/abstract/document/6248685

Re:Towards a Physics Foundation Model by flwi on Friday September 19, 2025 @01:27AM (#45298245)
I haven't seen electromagnetic systems included yet, probably since they are less training data for it.

In your chase, with such specific systems, a model trained only on your data might make more sense, though

Re:Towards a Physics Foundation Model by jrpt on Thursday September 18, 2025 @12:15PM (#45291460)
What do you think about the Nobel prize in physics going for neural networks last year? What combinations of AI + physics do you think will be most impactful and could potentially get a Nobel prize?
Re:Towards a Physics Foundation Model by lianmunoz on Thursday September 18, 2025 @05:59PM (#45295531)
Would you care to name any of the groups or papers you've had your eye on? Thanks!
Re:Towards a Physics Foundation Model by flwi on Friday September 19, 2025 @01:24AM (#45298230)
The Polymathic AI company does a lot of stuff in that direction.
Re:Towards a Physics Foundation Model by xxprogamerxy on Thursday September 18, 2025 @10:04PM (#45297211)
Very interesting! In your internal testing, did you also compare your results with the transformer model from this paper: https://arxiv.org/abs/2506.17774 from July?
Re:Towards a Physics Foundation Model by flwi on Friday September 19, 2025 @01:21AM (#45298217)
Very interesting paper! We did not run this model ourselves. From what I've understood, the results are in the same order of magnitude, but the model is 4x the size. And (similar to all other predecessors), they finetune on new physics instead of zero-shot