Free Dolly: Introducing the First Truly Open Instruction-Tuned LLM

Re:Free Dolly: Introducing the First Truly Open Instruction-... by IanCal on Wednesday April 12, 2023 @10:43AM (#35540553)

Quality is one aspect, running them is another. If I've already got everything setup with them and they work efficiently, they could also offer open source models and let me pay for usage. Both bursty usage and low constant usage benefit from paying per token and having some shared & large infrastructure to use. I don't want to be running a bunch of h100s, I just want my requests processed.

If they're selling gpt-5 and let me pay for LLaMa or whatever is also out then I'll just use them unless pricing is wildly different.

[ Parent | on HN ]

Re:Free Dolly: Introducing the First Truly Open Instruction-... by visarga on Wednesday April 12, 2023 @01:05PM (#35543003)

> I don't want to be running a bunch of h100s, I just want my requests processed.

Assuming you don't have sensitive data and that you never try anything outside the rules.

[ Parent | on HN ]

Re:Free Dolly: Introducing the First Truly Open Instruction-... by IanCal on Wednesday April 12, 2023 @02:16PM (#35544256)

Those are hosting issues really and shouldn't be an issue for most companies.

I'd be absolutely shocked if they don't launch a version where it's run on more secure setups, particularly as they've got huge Microsoft backing.

[ Parent | on HN ]

Re:Free Dolly: Introducing the First Truly Open Instruction-... by IanCal on Thursday April 13, 2023 @07:06PM (#35563377)

You can run this in azure which I feel solves basically all of the hosting issues.

[ Parent | on HN ]