News for hackers. Stuff that matters.
Re:Ask HN: Has Anyone Trained a personal LLM using their per... by KMnO4 on Thursday April 04, 2024 @12:00AM (#39926395)
Maybe not exactly what you’re asking, but I started doing talk therapy last year. It’s done virtually and I record the session with OBS. As soon as the recording finishes, the following happens:

- The audio is preprocessed (chunked) and sent to Whisper to generate a transcript

- The transcript is sent to GPT-4 to generate a summary, action items, concepts introduced with additional information

- The next meeting’s date/time is added to my calendar

- A chatbot is created that allows me to chat with each session, including playing the role as the therapist and continuing the conversation (with the entire context of what I actually talked about)

It’s been exceedingly helpful to be able to review all my therapy sessions this way.

Re:Ask HN: Has Anyone Trained a personal LLM using their per... by rhcom2 on Thursday April 04, 2024 @12:15AM (#39926464)
I'm sincerely happy you're finding value in this and it's a very impressive workflow. The idea of sending my therapy sessions to OpenAI sounds terrifying though.
Re:Ask HN: Has Anyone Trained a personal LLM using their per... by kid64 on Thursday April 04, 2024 @12:05AM (#39926419)
I hope you're the patient in this scenario, otherwise this is an egregious HIPAA violation.
Re:Ask HN: Has Anyone Trained a personal LLM using their per... by mmahemoff on Thursday April 04, 2024 @02:10AM (#39927076)
Might still be a violation if they're the patient? Unless therapist and their employer's consent is given and ofc dependent on the relevant jurisdictions (IANAL).
Re:Ask HN: Has Anyone Trained a personal LLM using their per... by aerhardt on Thursday April 04, 2024 @05:50AM (#39928354)
I don’t know about the legality of it, but as a comical skit it’d be hilarious: a patient gets in deep shit with their doctor for violating patient-doctor confidentiality. Sounds straight out of Curb Your Enthusiasm!

Edit: It seems it's straight out of Curb, because it is! https://youtu.be/YH55dFlF_Rg?si=kOLC5rGq5fi8tke2

Re:Ask HN: Has Anyone Trained a personal LLM using their per... by fullautomation on Thursday April 04, 2024 @12:27AM (#39926521)
This is really interesting, are your comfortable with OpenAI having your personal details in this case?
Re:Ask HN: Has Anyone Trained a personal LLM using their per... by Erazal on Thursday April 04, 2024 @06:32AM (#39928584)
This is where having our own LLMs and stacks running locally will save and empower us IMHO
Re:Ask HN: Has Anyone Trained a personal LLM using their per... by tqwhite on Thursday April 04, 2024 @10:08AM (#39930601)
OpenAI's privacy claims are fine. I wouldn't worry about this any more than I worry about my email provider.
Re:Ask HN: Has Anyone Trained a personal LLM using their per... by psychopomp on Thursday April 04, 2024 @12:29AM (#39926532)
I’d love to replicate your workflow. Any luck with speaker diarization using whisper? I’ve tried WhisperX several but it didn’t work.
Re:Ask HN: Has Anyone Trained a personal LLM using their per... by Erazal on Thursday April 04, 2024 @06:02AM (#39928426)
I've created an AI Meeting Bot API to do just that [1].

At the moment it runs on AWS, and we're thinking of open-sourcing so you could also run it locally to maintain 100% privacy of such conversations.

You'd get speaker diarization, names on top of the recording [2].

[1] https://aimeetingbot.com [2] https://spoke-1.gitbook.io/ai-meeting-bot

Happy to get in touch and have you run it

Re:Ask HN: Has Anyone Trained a personal LLM using their per... by xyst on Thursday April 04, 2024 @12:34AM (#39926554)
So much for patient and doctor confidentiality
Re:Ask HN: Has Anyone Trained a personal LLM using their per... by weikju on Thursday April 04, 2024 @12:42AM (#39926609)
I read this as the OP being the patient, not the doctor. Pretty sure a patient is free to violate this confidentiality
Re:Ask HN: Has Anyone Trained a personal LLM using their per... by ethbr1 on Thursday April 04, 2024 @12:48AM (#39926643)
Parent was probably referring to OpenAI having access to therapy notes, once GP sent them, and no legal responsibility to keep them private.
Re:Ask HN: Has Anyone Trained a personal LLM using their per... by serial_dev on Thursday April 04, 2024 @01:09AM (#39926775)
I'm sure OP knows this, thought about the risk, guessed the probabilities, assessed the nature of her therapy sessions, and decided the system she was building is worth the risk of her therapy content being available with an intuitive chat interface.

Not every therapy session is embarrassing, incriminating, or particularly interesting to anyone but you.

Re:Ask HN: Has Anyone Trained a personal LLM using their per... by mattlondon on Thursday April 04, 2024 @01:29AM (#39926870)
Off topic,but where did that gendering come from in your response? I am generally indifferent to personal pronouns but somehow this came across as particularly jarring as I guess it felt like a projection of misogynistic views of female weakness/need for therapy/emotionalness/etc. They/their might have been more appropriate here.
Re:Ask HN: Has Anyone Trained a personal LLM using their per... by serial_dev on Thursday April 04, 2024 @02:40AM (#39927245)
English is not my first language, so I beg for your forgiveness that I didn't use the they/them. In my language, there is no gendered pronouns, so it's hard for me to guess what's the correct way.

When I use he/him, people tell me I assume everyone on HN and tech is a male.

When I use she/her, you come and label me as misogynistic, too.

At one point I just give up. Or you know, you could also assume positive intent and not label someone misogynistic based on a comment where gender was not at all important to the discussion.

Re:Ask HN: Has Anyone Trained a personal LLM using their per... by melagonster on Thursday April 04, 2024 @03:07AM (#39927400)
you can use "they" at every where today. but I don't whether someone will accuse you support Trans community.
Re:Ask HN: Has Anyone Trained a personal LLM using their per... by mewpmewp2 on Thursday April 04, 2024 @04:18AM (#39927771)
Another possibility is to use "op", although it can feel a bit forumish.
Re:Ask HN: Has Anyone Trained a personal LLM using their per... by serial_dev on Thursday April 04, 2024 @04:56AM (#39928022)
I used OP, though, I didn't want to use "OP" every time I am referencing this person, I thought it would sound strange OP OP OP...

Anyway, I'm glad this thread turned into a "how you can avoid being called a misogynist in throwaway comment on HN". I guess from now on, I filter through my comments through Gemini to make sure my English is immaculate and that native English speakers don't castigate me for a small mistake.

Re:Ask HN: Has Anyone Trained a personal LLM using their per... by ethbr1 on Thursday April 04, 2024 @11:52AM (#39931984)
Mattlondon probably could have done without the color commentary, but I wouldn't take anything you did as wrong in English.

Our lack of singular neuter pronouns sucks. (I.e. singular 'they')

Re:Ask HN: Has Anyone Trained a personal LLM using their per... by iamcreasy on Thursday April 04, 2024 @12:35AM (#39926565)
Did you discover anything interesting by being able to review all the therapy sessions?
Re:Ask HN: Has Anyone Trained a personal LLM using their per... by Erazal on Thursday April 04, 2024 @06:00AM (#39928406)
wow - really cool.

I'm actually the founder of an AI Meeting Bot company - and we're thinking of open-sourcing so you could run exactly this set-up locally with perfect diarization / recording while also maintaining privacy [1].

I'm currently creating code examples, and just finished the "chat with each session". Would love to know how you implemented it.

[1] https://aimeetingbot.com

Re:Ask HN: Has Anyone Trained a personal LLM using their per... by LethoETH on Thursday April 04, 2024 @09:16AM (#39930011)
We're currently trying out - https://aimeetingbot.com Impressive!
Re:Ask HN: Has Anyone Trained a personal LLM using their per... by davidgu on Wednesday April 17, 2024 @09:55PM (#40072191)
I'm obviously biased as the founder, but check out https://recall.ai/ for a meeting bot API.

We serve over 300 companies, process millions of hours of recording a year, and are officially partnered with Zoom.

Re:Ask HN: Has Anyone Trained a personal LLM using their per... by NicoJuicy on Thursday April 04, 2024 @09:42AM (#39930312)
Curious on the code. ( a friend is a psychiatrist and she noticed difficulty with multiple languages and device translations).

This flow could help me improve fluency in her sessions ( eg. she has a hardware translation device (expensive) which has significant issues auto translating ), since it's missing context a lot.

Eg. When grieving is incorrectly translated between dutch-polish, it defeats a bit of the purpose of being fluent in your native language.

Reducing the error rate would help a lot.