News for hackers. Stuff that matters.

Ask HN: Locally Run Text to Speech+AI: ePub|PDF –> Audio Book

I've been researching this for a while, without success. Maybe, as I am not entirely connected to the AI-trendy world there's a solution for this?

I am looking for a text to speech (TTS) tool/toolchain. That would ideally transform a document such as an EPUB into an audio book.

An adjacent request would be, to understand HOW to generate locally the equivalent of "NotebookLM Podcasts".

If you don't know what those are:

* go there https://notebooklm.google.com/

* create a new notebook

* upload a document, like a big complicated book

* press "generate" on the right part;

* wait a little

* boom, now you can listen to an audio podcast entirely based on the book you sent where two fictional hosts discuss the book in question in a relatively thorough manner.

---

So yeah, I wonder what are the available, Free Software/Open Source, tools or tool chains that we can use locally on a reasonably powerful hardware at home to create text to speech using AI.

My ultimate goal would be to be able to generate audio books from EPUB/PDFs.

( 9 comments | 3 points | on HN )
Re:Ask HN: Locally Run Text to Speech+AI: ePub|PDF –> Audio ... by billconan on Monday February 17, 2025 @09:15AM (#43079214)
Re:Ask HN: Locally Run Text to Speech+AI: ePub|PDF –> Audio ... by mrjay42 on Monday February 17, 2025 @01:05PM (#43081677)
Thanks, I'm testing it out right now <3.

My search for "EPUB to Audio book" is still going on though :3

Re:Ask HN: Locally Run Text to Speech+AI: ePub|PDF –> Audio ... by mrjay42 on Tuesday February 18, 2025 @05:11AM (#43087992)
Coming back here to say that this project is not free (as in, you need to pay). It requires an API key that is only available if you pay :(
Re:Ask HN: Locally Run Text to Speech+AI: ePub|PDF –> Audio ... by zertrin on Monday February 17, 2025 @02:16PM (#43082325)
Just a couple days ago, I saw this project mentioned. Looks promising but I haven't had the time to try it yet so this isn't an endorsement.

https://claudio.uk/posts/audiblez-v4.html

Re:Ask HN: Locally Run Text to Speech+AI: ePub|PDF –> Audio ... by satvikpendem on Monday February 17, 2025 @03:36PM (#43083064)
Re:Ask HN: Locally Run Text to Speech+AI: ePub|PDF –> Audio ... by mrjay42 on Tuesday February 18, 2025 @05:17AM (#43088017)
Aaaand checking this one out too. Thanks :3
Re:Ask HN: Locally Run Text to Speech+AI: ePub|PDF –> Audio ... by mrjay42 on Tuesday February 18, 2025 @05:12AM (#43087995)
Thanks, I'm gonna check it out right now.
Re:Ask HN: Locally Run Text to Speech+AI: ePub|PDF –> Audio ... by mrjay42 on Saturday February 22, 2025 @05:02AM (#43137654)
Just coming back here for a little report. This tool "audiblez" works fine and out of the box.

Pros:

* works out of the box

* text to speech available in many languages!!

* Audio output in .wav -> easily convertible into something else

* automatically creates chapters based on the book

The limitations are: * the voices are very "AI"-style, so they sound emotionless, we're far from anything resembling any kind of acting;

* the conversion of a book into an audiobook might just crash if the script encounters a character that it doesn't know how to convert.

Re:Ask HN: Locally Run Text to Speech+AI: ePub|PDF –> Audio ... by zertrin on Sunday February 23, 2025 @11:11AM (#43150331)
Yes I've also tried it and reached similar conclusions. Do update it to the latest version though, as I did report an issue with non ASCII characters and for me it got fixed in v0.4.7+