Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh...
by sp332 on Monday January 08, 2024 @08:55AM
(#38911924)
That's the whole context with two user inputs in the INST tags, and one assistant output between/outside of the tags. They're just simulating the beginning of a conversation. You can see this very clearly in the JSON version in the next code block:
[ Parent
| on HN ]
Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh...
by nl on Monday January 08, 2024 @04:47PM
(#38918657)
Yes, but this whole block of text gets passed to the LLM on each call as the conversation history. The [INST] tags tell the LLM which parts were inputs (system instructions) as opposed to outputs.
Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh...
by sp332 on Monday January 08, 2024 @05:43PM
(#38919406)
Well, that's not what a system prompt is. There is a difference between system prompts and regular conversational inputs. https://platform.openai.com/docs/guides/prompt-engineering/t...