News for hackers. Stuff that matters.

Show HN: Panza: A personal email assistant, trained and running on-device

https://github.com/IST-DASLab/PanzaMail

Tired of crafting well-polished emails and wish you had an assistant to take over the hard work while mimicking your writing style? Introducing Panza, a personalized LLM email assistant that runs entirely on your device! Choose between Llama-3 or Mistral, tailor it to your unique style, and let it write the emails for you. Take a look at our demo and give it a try on your emails at: https://github.com/IST-DASLab/PanzaMail

Some technical details about Panza:

- Panza is an automated email assistant customized to your writing style and past email history.

- Panza produces a fine-tuned LLM that matches your writing style, pairing it with a Retrieval-Augmented Generation (RAG) component which helps it produce relevant emails.

- Panza *can be trained and run entirely locally*. Currently, it requires a single GPU with 16-24 GiB of memory, but we also plan to release a CPU-only version.

- Training and execution are also quick - for a dataset on the order of 1000 emails, training Panza takes well under an hour, and generating a new email takes a few seconds at most.

( 4 comments | 2 points | on HN )
Re:Show HN: Panza: A personal email assistant, trained and r... by throwaway888abc on Friday May 03, 2024 @11:53AM (#40249091)
This is so cool!
Re:Show HN: Panza: A personal email assistant, trained and r... by chema on Friday May 03, 2024 @03:40PM (#40251491)
I've been waiting for something like this. I've got most of my emails, text messages and social media posts since 1997. One day I'm going to load it all up on something like this.
Re:Show HN: Panza: A personal email assistant, trained and r... by snthpy on Sunday May 05, 2024 @02:26AM (#40262706)
Same here. Looking forward to trying this out.
[dead]
Re:Show HN: Panza: A personal email assistant, trained and r... by eldar_ciki on Monday May 06, 2024 @04:28AM (#40272449)
you might want to open an issue in our git repo, and if there is interest we would be more than happy to add a solution for Apple silicon