Ask HN: People who were laid off or quit recently, how are you doing?

Re:Ask HN: People who were laid off or quit recently, how ar... by AmazingTurtle on Thursday April 20, 2023 @01:44PM (#35643517)

You can use vicuna-7b-1.1. No need for chat prompts. Just slam in your data and end it off like so

Generate a JSON with this and that {"this": "

Lower the temperature to minimum for deterministic results, fine tune the other parameters if needed. And have a stop token for JSON closing tag like so }.

That usually works perfectly fine for me in most scenarios. Best: that stuff runs on RTX 3080 with 15token/s (quite fast!). Also vicuna-7b is pretty much as good as gpt-3 when it came out.

[ Parent | on HN ]

Re:Ask HN: People who were laid off or quit recently, how ar... by arthurcolle on Friday April 21, 2023 @01:23PM (#35657078)

Vicuna-7b is much better than Gpt4All, but still struggles with math - I can't wait until my new work computer comes in, I will try to run the new StableLM models

[ Parent | on HN ]