Re:Show HN: I record myself on audio 24x7 and use an AI to p...
by dsalzman on Tuesday November 15, 2022 @10:11AM
(#33610073)
I've been experimenting with this recently as well, but with an app on my apple watch. Looking for a method/model to split different speakers into different tracks to only look at audio from myself and certain people.
[ Parent
| on HN ]
Re:Show HN: I record myself on audio 24x7 and use an AI to p...
by dsalzman on Tuesday November 15, 2022 @10:15AM
(#33610124)
Someone is experimenting with diarization (speaker identification) + Whisper here https://github.com/openai/whisper/discussions/264
Re:Show HN: I record myself on audio 24x7 and use an AI to p...
by fragmede on Tuesday November 15, 2022 @02:12PM
(#33613553)
If you know how many speakers there are, https://twitter.com/dwarkesh_sp has it working here:
https://colab.research.google.com/drive/1V-Bt5Hm2kjaDb4P1RyM...
Re:Show HN: I record myself on audio 24x7 and use an AI to p...
by jordanlwalker on Tuesday November 15, 2022 @10:40AM
(#33610490)
we're experimenting building out a version of this too, but on desktop with www.usebacktrack.com - should have splitting speakers/inputs early next year and seeing what that's like
Re:Show HN: I record myself on audio 24x7 and use an AI to p...
by TOMDM on Tuesday November 15, 2022 @10:17AM
(#33610144)
Check out this model, I've had limited success with it.
Best I've done so far is to just add the labels it gives to the overlapping segments whisper spits out, which means some sentences have multiple speakers, but that's mostly the case because of cross-talk. I'd say it gets it right ~80% of the time with the 5 speakers I've done it on across ~16 hours of audio.
Re:Show HN: I record myself on audio 24x7 and use an AI to p...
by dsalzman on Tuesday November 15, 2022 @10:26AM
(#33610273)
I will!
Re:Show HN: I record myself on audio 24x7 and use an AI to p...
by roberdam on Tuesday November 15, 2022 @10:17AM
(#33610145)
Speaker identification is the next step, you might want to read about Pyannote's Diarization:
https://lablab.ai/t/whisper-transcription-and-speaker-identi...
Re:Show HN: I record myself on audio 24x7 and use an AI to p...
by waprin on Tuesday November 15, 2022 @11:41AM
(#33611470)
Ahh I’m working on exact same project. I applied to YC with the idea and was told that “nobody wants this” during the interview.
There’s a ton of problems in the space around privacy and UX. But I’m incredibly excited about projects in this space because in modern society we’re basically surrounded by a million unhealthy things designed to tempt us. Logging forces you to “stay honest”. I’ve been shocked already by how many unhealthy habits I underestimated and how many healthy habits I overestimated.
My #1 priority is just to improve my own physical and mental health. Whether there’s a market for this stuff, who knows.
Good luck!
Re:Show HN: I record myself on audio 24x7 and use an AI to p...
by dsalzman on Tuesday November 15, 2022 @12:27PM
(#33612244)
My original inspiration is to better understand how I talk to others and study my own behavior
Re:Show HN: I record myself on audio 24x7 and use an AI to p...
by waprin on Tuesday November 15, 2022 @12:55PM
(#33612613)
A noble goal. One of my bad habits I've been tracking and trying to reduce is rude behavior to people, online or in-person.
Re:Show HN: I record myself on audio 24x7 and use an AI to p...
by hipjiveguy on Thursday November 17, 2022 @08:25PM
(#33648579)
what app are you using on the apple watch?