Re:Wavecoder – a CodeLLM with 6.7B params scoring just behin...
by anon373839 on Thursday January 18, 2024 @01:45AM
(#39038744)
With the exception of task specialization. Fine-tuning a small model such as Mistral 7B on a specific set of tasks can outperform using GPT-4 on those tasks, and with cheaper and faster inference.
[ Parent
| on HN ]
Re:Wavecoder – a CodeLLM with 6.7B params scoring just behin...
by eightysixfour on Thursday January 18, 2024 @11:16AM
(#39043587)
Not on the leaderboards mentioned here. That’s my point, you can overfit for specific tasks, you can’t beat them on multi-task leaderboards without training on the test data.