News for hackers. Stuff that matters.

A comment on Large Enough – Mistral AI. Parent comment

Re:Large Enough – Mistral AI by impossiblefork on Wednesday July 24, 2024 @05:00PM (#41062054)
So do it locally after predigesting the book, so that you have the entire KV-cache for it.

Then load that KV-cache and add your prompt.

[ Parent | on HN ]

There are no comments on this comment yet.