Re:Phi-2: Self-Extend Boosts Performance, Extends Context to...
by te_chris on Friday January 12, 2024 @03:07PM
(#38973263)
Has anyone successfully fine tuned it for function calling? Thinking could use a lightweight model like this to interpret args in a pipeline then format them for passing down the chain
[ Parent
| on HN ]
Re:Phi-2: Self-Extend Boosts Performance, Extends Context to...
by aluxian on Tuesday January 16, 2024 @03:08PM
(#39018377)
Thought the same. Ollama has a JSON mode, it's the closest I got to using it for function calling:
brew install ollama
brew services start ollama
curl http://localhost:11434/api/generate -d '{
"model": "phi:2.7b-chat-v2-q5_K_M",
"prompt": "Generate a JSON object that models a list of products",
"raw": true, "format": "json",
"stream": false
}' | jq
If you want to keep in touch / share intel: linkedin.com /in/ aluxian or `me` at my username dot com