News for hackers. Stuff that matters.
Re:Fmllm: 4mb training data, 100mb model, Fibonacci embeddin... by almatia on Friday August 22, 2025 @07:23AM (#44983159)
Couldn't this coherence be obtained with Markov chains fed with your texts? I found this: https://medium.com/@preranabora12/text-generating-with-marko...

For creative writing it's true the "most common word based on your personal corpus for this input" could be useful as a hint input on an llm-powered creative text UI like loom: https://github.com/socketteer/loom

Re:Fmllm: 4mb training data, 100mb model, Fibonacci embeddin... by gabriel666smith on Friday August 22, 2025 @09:40AM (#44984572)
Yep, the latter is far more interesting I think! Those results I got in the other file in the repo were fascinating to me