Your code is pretty small if it fits within the context if any major LLM. But very nice if it does!
Re:GitHub Copilot: The Agent Awakens
by singularity2001 on Friday February 07, 2025 @04:11AM
(#42970782)
doesn't it get very expensive quickly if you don't use prompt cashing
I've had the occasional large prompt that cost ~30c - I often use GPT-4o mini if I'm going to ask follow-up questions because then I get prompt caching without having to configure it.
https://github.com/bodo-run/yek
This is more sophisticated for serializing your repo. Please check it out and let me know what do you think?
Yek is fantastic -- I've converted my whole team to using it for prompting. As input context windows keep increasing, I think it'll just keep becoming more and more valuable -- I can put most of my team's code in Gemini 2.0 now.
Here's a recent example:
https://gist.github.com/simonw/bee455c41d463abc6282a5c9c132c...