News for hackers. Stuff that matters.
Re:Show HN: Yet Another Memory System for LLM's by elpocko on Thursday August 14, 2025 @08:03AM (#44899400)
>block-level deduplication (saves 30-40% on typical codebases)

How is savings of 40% on a typical codebase possible with block-level deduplication? What kind of blocks are you talking about? Blocks as in the filesystem?

Re:Show HN: Yet Another Memory System for LLM's by blackmanta on Thursday August 14, 2025 @10:44AM (#44900993)
I am working to improve the CLI tools to make getting this information easier but I have stored the yam repo in yams with multiple snapshots and metadata tags and I am seeing about 32% storage savings.
Re:Show HN: Yet Another Memory System for LLM's by elpocko on Thursday August 14, 2025 @11:01AM (#44901215)
Cool. I have no idea what "stored the yam repo in yams" means. What do you mean by "block-level deduplication"? What is a block?
Re:Show HN: Yet Another Memory System for LLM's by blackmanta on Thursday August 14, 2025 @11:10AM (#44901340)
I stored the codebase for yams in the tool. The "blocks" are content-defined blocks/chunks, not filesystem blocks. They're variable-size chunks (typically 4-64KB) created using Rabin fingerprinting to find natural content boundaries. This enables deduplication across files that share similar content.