oaguy1
Re:Llama2.c: inference llama 2 in one file of pure C
on Monday July 24, 2023 @04:49AM (#36844748)
I also trained nanoGPT on TinyStories, produced about a 32M model. The results are amazing, especially considering I opted for a character-level model similar to the toy dataset in the repo. I’m writing about the experience while also doing a deep dive into the code on medium (username oaguy1). Smaller LLMs are definitely worth considering with the right quality training data. Once I finish playing with TinyStories, I recently tweaked the Standardized Project Gutenberg Corpus (~11GB) to be more modern. Want to see what I can do with it with nanoGPT and then maybe Huggingface’s libraries.
Play a text based adventure with LLMs
Re:Reactive Clojure: A web language
on Thursday September 23, 2021 @12:48PM (#28631721)
Hugged to death and I’m afraid there is no wayback archive right now.
Re:FreedomBox: Run your digital services from your home
on Monday February 08, 2021 @09:25AM (#26064828)
Has anyone here tried using WireGuard as a VPN for selfhosting? It is built into the Linux kernel (starting in 5.4?) and has lots of tutorials. Thinking of using it for my next project.
Re:Mute Your Microphone While Typing with Hushboard
on Friday January 08, 2021 @02:20PM (#25688924)
This is a really cool, small utility!
TBH, I have been wondering if there is a "wishlist" of small utilities/apps people would want to see on the Linux desktop. I have been looking for project inspiration and would love to do something that actually gets used.