Re:Liquid Foundation Models: Our First Series of Generative ...
by aithrowawaycomm on Monday September 30, 2024 @01:53PM
(#41700020)
But they also say
> What are Language LFMs good at today:
> General and expert knowledge
> Mathematics and logical reasoning
"Our LLM is good at mathematics but bad at computation" doesn't really cut the mustard here. What they mean is "good at well-known math benchmarks but bad at simple math problems that it hasn't been trained on." The idea that this constitutes "mathematics and logical reasoning" is a testament to AI companies' poor scientific standards.
>What are Language LFMs not good at today:
>Zero-shot code tasks
>Precise numerical calculations
>Time-sensitive information
>Counting r's in the word "Strawberry"!
>Human preference optimization techniques have not been applied extensively to our models yet.
Maybe it's just not trained/tuned for math-related challenges. Or maybe it's an architectural challenge.