News for hackers. Stuff that matters.
Re:Teach kids to read with ASR and computer vision. Reading ... by caprock on Thursday September 08, 2022 @07:32PM (#32773458)
This is pretty neat! It's great to see relatively recent advancements in machine learning, put to use for child education.

A few questions for @Cherian:

1. I see the ASR usage, but where does computer vision come into play?

2. Are you training and/or fine tuning asr models to deal with the speech characteristics of children and new speakers?

3. Is the asr all cloud side, or do you have it running locally in some fashion?

Re:Teach kids to read with ASR and computer vision. Reading ... by rohit_osmo on Thursday September 08, 2022 @08:01PM (#32773682)
Reading Adventure uses computer vision to help kids read through the books. The vision tech is used in combination with a “wand” to figure out the pages, words, and letters the kid is pointing to.
Re:Teach kids to read with ASR and computer vision. Reading ... by zpavlov on Thursday September 08, 2022 @08:08PM (#32773746)
heyo,

2. The model is primarily focused around kids, with focus on repeated words and partial words

3. ASR is local to device. We are using a focused model per book

Re:Teach kids to read with ASR and computer vision. Reading ... by caprock on Thursday September 08, 2022 @08:34PM (#32773905)
Thanks for all the answers and insight!