Re:Refact LLM: New 1.6B code model reaches 32% HumanEval and...
by paulsutter on Monday September 04, 2023 @01:53PM
(#37383043)
Especially interested in learning directly on geometries, please keep us updated and share results
[ Parent
| on HN ]
Re:Refact LLM: New 1.6B code model reaches 32% HumanEval and...
by taywrobel on Monday September 04, 2023 @02:56PM
(#37383685)
Would definitely recommend Bronstein et. al's work on geometric deep learning! https://geometricdeeplearning.com
That's effectively the right hand side of the bridge that we're building between formal logic and deep learning. So far their work has been viewed mainly as descriptive, helping to understand neural networks better, but as their abstract calls out: "it gives a constructive procedure to incorporate prior physical knowledge into neural architectures and provide principled way to build future architectures yet to be invented". That's us (we hope)!