Show HN: Llm.sql – Run a 640MB LLM on SQLite, with 210MB peak RSS and 7.4 tok/s

Re:Show HN: Llm.sql – Run a 640MB LLM on SQLite, with 210MB ... by benlimanto on Friday April 24, 2026 @08:11AM (#47889139)

This is a good sample, how far you can push to edge device? Any usecase like in raspberry pi?

[ Parent | on HN ]

Re:Show HN: Llm.sql – Run a 640MB LLM on SQLite, with 210MB ... by aldielshala on Friday April 24, 2026 @08:36AM (#47889358)

Haven't tested on a Pi yet, llm.sql is still in alpha, focused on validating that SQLite can actually work for LLM inference and profiling memory usage. That said, 210MB peak RSS should fit comfortably on a Pi. In theory, any device that runs SQLite (which is almost every device) could run llm.sql. Planning to benchmark across different hardware as the project matures.

[ Parent | on HN ]