Re:Llama.cpp Now Supports Qwen2-VL (Vision Language Model)
by antupis on Sunday December 15, 2024 @05:34AM
(#42422724)
Have you tested tool calling capabilities of these cheaper models?
[ Parent
| on HN ]
Re:Llama.cpp Now Supports Qwen2-VL (Vision Language Model)
by simonw on Sunday December 15, 2024 @07:46AM
(#42423145)
Not yet. A lot of them make bold claims and there are benchmarks like https://gorilla.cs.berkeley.edu/leaderboard.html but I don't have my own function calling test harness setup yet.
Re:Llama.cpp Now Supports Qwen2-VL (Vision Language Model)
by leobg on Sunday December 15, 2024 @04:35PM
(#42426145)
You know that you can make any model call and use tools simply by giving it few shot examples and writing your own parsing logic. I’ve done it many times for clients, both at the prompt and at the fine-tune level.