Re:Experimenting with Local LLMs on macOS
by rukuu001 on Monday September 08, 2025 @07:29PM
(#45175487)
I'm running Gemma3-270M locally (MLX). I got a Python script that pulls down emails based on a whitelist and summarises them. The 270M model does a good job of this. This is running in a terminal. It means I barely look at my email during the day.
[ Parent
| on HN ]
Re:Experimenting with Local LLMs on macOS
by ghilston on Monday September 08, 2025 @08:58PM
(#45176138)
Any willingness to share this script? I've been working on some code to ingest things and summarize for them and I haven't gotten to email just yet.
Re:Experimenting with Local LLMs on macOS
by rukuu001 on Monday September 08, 2025 @11:39PM
(#45177132)
Watch this space. It’s pretty scrappy code and needs a cleanup. It also does other random stuff relating to calendar entries that I want to be reminded to appropriately prepare for.
But yes I’ll share, and I guess post an update in this thread?
Re:Experimenting with Local LLMs on macOS
by ghilston on Tuesday September 09, 2025 @08:21AM
(#45180952)
Okay will do. Yeah, I just finished my calendar reading code. I haven't prepared the data for my LLM ingestion yet. Sounds great, I'll refresh this thread in a few days
Re:Experimenting with Local LLMs on macOS
by renmillar on Tuesday September 09, 2025 @04:40PM
(#45188658)
I’d suggest the simple approach: run that script through Claude and have it extract just the email processing parts to create a clean CLI tool. This seems like exactly the type of refactoring task that LLMs are really good at.