News for hackers. Stuff that matters.
Re:Nearly Half of Firms Are Drafting Policies on ChatGPT Use by satvikpendem on Monday March 20, 2023 @02:28PM (#35236296)
I'm working on an open source startup to allow companies to self host OSS AI/LLM models on their own infrastructure, whether through AWS/GCP/Azure/DigitalOcean/etc or on their physical servers. I'm fine tuning models with prompts and then I'll build out the API so that users and other developers can query them. This way, you send nothing back to a proprietary service.

Is anyone else interested in something like this?

Re:Nearly Half of Firms Are Drafting Policies on ChatGPT Use by cyrialize on Monday March 20, 2023 @04:04PM (#35237797)
Absolutely. I'm just an IC though, so I have no sway. That being said, this is something I've been talking about for a while now with co-workers. Being able to run an LLM on your codebase and query it just for your code would be fantastic!
Re:Nearly Half of Firms Are Drafting Policies on ChatGPT Use by satvikpendem on Monday March 20, 2023 @04:10PM (#35237876)
Yep, there are some efforts like this already, I recently posted this: https://news.ycombinator.com/item?id=35226097

Albeit, it is using proprietary GPT instead.

Re:Nearly Half of Firms Are Drafting Policies on ChatGPT Use by jacooper on Monday March 20, 2023 @08:29PM (#35240886)
Anywhere where we can follow updates on this?
Re:Nearly Half of Firms Are Drafting Policies on ChatGPT Use by satvikpendem on Monday March 20, 2023 @08:35PM (#35240949)
If you could just email me (in my profile) that'd be great, then I could keep track of people.