News for hackers. Stuff that matters.

chhabraamit

Re:Reflection 70B, the top open-source model on Thursday September 05, 2024 @07:33PM (#41461351)
what's our estimate of the cost to finetune this?
one of the things I would want in such custom client is that having features which are part of right their corresponding official clients like artifacts, python code execution, "whatever chatgpt does when the convo surpasses the context length" etc
Re:Introducing Structured Outputs in the API on Tuesday August 06, 2024 @02:04PM (#41173464)
How does llama.cpp’s grammar adherence work?

Does it keep validating the predicted tokens and backtrack when it’s not valid?

Re:Binance built a 100PB log service with Quickwit on Thursday July 11, 2024 @04:02PM (#40940106)
yup, nice idea. keep collecting logs in a flow and only log when there is an error. Or

Start logging in a buffer and only flush when there is an error.

Re:DNS record "hn.algolia.com" is gone on Monday October 09, 2023 @01:45PM (#37823095)
tell me more about your searching process here
Re:Show HN: Qwokka – see what's great on Netflix on Friday July 21, 2023 @02:52PM (#36817903)
I would love if I could run this on my TV
And how do we make that happen?