News for hackers. Stuff that matters.
Re:Ask HN: How to send context when you use LLMs via API for... by fdarkaou on Monday July 29, 2024 @03:16PM (#41102915)
most LLMs today have a large context window where you can send a history of your chat

i've built multiple chat demo apps (see anotherwrapper.com) and there what i basically did was store a full copy of the history in the DB & then in a config file i specified how many previous messages i want to include in my chat history when interacting to the API

Re:Ask HN: How to send context when you use LLMs via API for... by msnkarthik on Tuesday July 30, 2024 @03:26AM (#41106837)
got it. this helps thanks. Which models are you using for this?