News for hackers. Stuff that matters.
Re:ChatGPT vs. open source on harder tasks by hm-nah on Friday May 19, 2023 @01:50AM (#35998257)
I think these guys could benefit from better prompts.

When I use chat prompting…

- system: sets the context for the bot

  - “You are…”
  - “Act like…”
  - “Pretend…”
- assistant: specifies the task to be performed

  - “Classify…”
  - “Extract entities…”
  - “Translate…”
- user: asks the question, adds examples

These guys were asking questions and giving examples in the assistant prompt. I feel like that messed up the LLMs responses.

I can’t wait to try Vicuña and MPT. I can’t quite figure out how to host them in Azure without an expensive VM. Maybe Azure DataBricks…?

Re:ChatGPT vs. open source on harder tasks by MacsHeadroom on Friday May 19, 2023 @09:39AM (#36001801)
You can run Vicuna at chatGPT speeds locally off of CPU. idk about MPT.