I'm making LLMs work on small and old devices

Re:I'm making LLMs work on small and old devices by MomsAVoxell on Thursday November 12, 2026 @12:58PM (#50471381)

Speech recognition, speech generation.

This alone is quite useful in small/limited devices/contexts.

Realtime log parsing and summarization is another application I've seen for little LLM's..

Basically, anywhere you'd use an LLM, but at much, much smaller scales of ontology.

[ Parent | on HN ]

Re:I'm making LLMs work on small and old devices by mrashad74 on Thursday November 12, 2026 @02:28PM (#50472863)

speech models are what I'm trying next because imagine a nice portable meeting transcription device that can hold around without internet and for NDA-ed meetings and so (with permission of course)

[ Parent | on HN ]