News for hackers. Stuff that matters.

A comment on Llama 2 on togetherAI is as bad of a privacy nightmare as OpenAI. Parent comment

Re:Llama 2 on togetherAI is as bad of a privacy nightmare as... by benxh on Friday September 08, 2023 @03:45PM (#37438479)
I've had some success using vast.ai[0] with the Oobabooga LLM WebUI (LLaMA2) instances. One click to start up, minimal editing in the interface settings to enable OpenAI compatible interface.

[0] https://cloud.vast.ai/

[ Parent | on HN ]

There are no comments on this comment yet.