News for hackers. Stuff that matters.

A comment on Anthropic's Haiku Beats GPT-4 Turbo in Tool Use. Parent comment

Re:Anthropic's Haiku Beats GPT-4 Turbo in Tool Use by Joschkabraun on Monday April 08, 2024 @02:19PM (#39972379)
What do you mean with being a bad model?

If the model is really good at tool use, then it will broadly useful as it needs capabilities to generate the tool definition. So, there should be some transferability.

[ Parent | on HN ]
Re:Anthropic's Haiku Beats GPT-4 Turbo in Tool Use by ec109685 on Monday April 08, 2024 @10:25PM (#39975761)
If the exact tools test was part of the training of the model, wouldn’t that throw off the results and not generalize?
[ Parent | on HN ]