News for hackers. Stuff that matters.

A comment on I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros. Parent comment

Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by sp332 on Monday January 08, 2024 @05:43PM (#38919406)
Well, that's not what a system prompt is. There is a difference between system prompts and regular conversational inputs. https://platform.openai.com/docs/guides/prompt-engineering/t...
[ Parent | on HN ]
Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by nl on Monday January 08, 2024 @08:09PM (#38920928)
In actual fact system prompts are just the instruction tuning prompts that provide instructions formatted in the correct way (ie, with [INST]). It's just text all the way down.
[ Parent | on HN ]