ybu
Re:Show HN: a desktop app to discover, download, and run offline LLMs
on Saturday May 27, 2023 @09:53AM (#36094847)
Follow up: Windows release is out.
Re:Show HN: a desktop app to discover, download, and run offline LLMs
on Wednesday May 24, 2023 @03:58PM (#36063174)
Focus is CPU for now - but it'd be very useful to have GPU support. As a baseline, this can support anything that llama.cpp. Relevant link: https://github.com/ggerganov/llama.cpp#blas-build
Re:Show HN: a desktop app to discover, download, and run offline LLMs
on Wednesday May 24, 2023 @12:47PM (#36060754)
hopefully soon!
Re:Revealing example of self-attention, the building block of transfor...
on Saturday April 29, 2023 @06:44PM (#35757997)
In this context worth calling out Andrej Karpathy's youtube playlist on neural networks [0].
In the last video ("Let's build GPT: from scratch...") Andrej codes up a transformer model, in conjunction with the paper [1].
[0] https://www.youtube.com/playlist?list=PLAqhIrjkxbuWI23v9cThs...
Self-hosted dashboard for monitoring your OpenAI API usage
Show HN: tokmon – CLI to monitor your program's OpenAI token costs
Re:Show HN: ChatIDE – Talk with ChatGPT inside VS Code
on Tuesday April 04, 2023 @02:12PM (#35443761)
Now that you mention it ... GPT did say "don't worry about it" ...
Jokes aside, I didn't want to deal with distributing it just yet. People are welcome to package it and install it themselves from source.
Re:Show HN: ChatIDE – Talk with ChatGPT inside VS Code
on Tuesday April 04, 2023 @02:11PM (#35443749)
Very cool! Adding the current file / selection to the context of the convo with GPT is definitely a great idea.
Show HN: ChatIDE – Talk with ChatGPT inside VS Code
https://github.com/yagil/ChatIDE
ChatIDE is a sort of a DIY Github copilot X.Launch ChatIDE with a `Cmd + Shift + i`. You bring your own OpenAI api key. You can set the system prompt, temperature, and max tokens in the extension settings.The extension is currently not aware of any of the files in your project, although that might be cool to add later. Use it just like you would use ChatGPT in the browser. Feedback and...