News for hackers. Stuff that matters.
Re:Refact LLM: New 1.6B code model reaches 32% HumanEval and... by taywrobel on Monday September 04, 2023 @02:56PM (#37383685)
Would definitely recommend Bronstein et. al's work on geometric deep learning! https://geometricdeeplearning.com

That's effectively the right hand side of the bridge that we're building between formal logic and deep learning. So far their work has been viewed mainly as descriptive, helping to understand neural networks better, but as their abstract calls out: "it gives a constructive procedure to incorporate prior physical knowledge into neural architectures and provide principled way to build future architectures yet to be invented". That's us (we hope)!

There are no comments on this comment yet.