News for hackers. Stuff that matters.
Re:How to run Llama 13B with a 6GB graphics card by xrd on Wednesday May 24, 2023 @05:33PM (#36064148)
Can you share more about what you are doing or what you've seen others doing?
Re:How to run Llama 13B with a 6GB graphics card by jhbadger on Sunday June 04, 2023 @01:46AM (#36183381)
Just noticed this response, but generally something like "act as a game master of a rpg. The setting is in a medieval style world with magic and my character is a rogue who is good at fast talking and pickpocketing"

Then the LLM generally creates an adventure that I can interact with,