News for hackers. Stuff that matters.

A comment on A framework to securely use LLMs in companies – Part 1: Overview of Risks. Parent comment

Re:A framework to securely use LLMs in companies – Part 1: O... by joj123 on Wednesday July 19, 2023 @10:02PM (#36796070)
(Author of the newsletter here) It's early days, but the simplest use case has been to improve employee productivity (Github Copilot, ChatGPT etc.). The Stripe CEO just tweeted that over half of their employees are using an internal LLM tool they built (folks who build internal tooling know how hard it is to drive adoption to a non-mandatory tool): https://twitter.com/patrickc/status/1681699442817368064?s=20

There are other companies which are doing some crazy experimental things which may have a large impact. For instance, Truveta is cleaning up on millions of medical records, training a model on that data and using that to drive research about patient care. Too early to tell if LLMs will actually transform companies beyond slight bumps in productivity, but to me, it feels like the cloud computing moment from 12-15yrs ago.

[ Parent | on HN ]
Re:A framework to securely use LLMs in companies – Part 1: O... by kristianp on Wednesday July 19, 2023 @11:26PM (#36796569)
The Stripe tool is probably just a chatbot built on openAI's API? Avoids the privacy concerns of using chatgpt.
[ Parent | on HN ]
Re:A framework to securely use LLMs in companies – Part 1: O... by pigeons on Thursday July 20, 2023 @05:25PM (#36806955)
How does this address the privacy concerns? OpenAI could still accidentally provide your data to other users, they could retain, sell or misuse it despite agreeing not to, or a rogue employee or an intruder could do so, or they could be forced to do so by a court order, etc.
[ Parent | on HN ]
Re:A framework to securely use LLMs in companies – Part 1: O... by kristianp on Saturday July 22, 2023 @12:54AM (#36823415)
There are privacy concerns with using ChatGPT, as data is collected by openai - opt out. Using the API has less privacy concerns as it is not used for training by openai.
[ Parent | on HN ]
Re:A framework to securely use LLMs in companies – Part 1: O... by joj123 on Friday July 21, 2023 @03:39AM (#36811078)
I have no idea what they have built. Hope they talk about it though :)
[ Parent | on HN ]
Re:A framework to securely use LLMs in companies – Part 1: O... by f6v on Thursday July 20, 2023 @01:45AM (#36797237)
> It's early days, but the simplest use case has been to improve employee productivity

Does anyone know if the impact has been properly measured? It’s one thing to say that “developers are more productive” and another to really have faster feature delivery (or any other metric).

[ Parent | on HN ]