News for hackers. Stuff that matters.
Re:Llamafile lets you distribute and run LLMs with a single ... by MattDaEskimo on Thursday November 30, 2023 @12:20PM (#38476108)
The new GPT-4 model has a context length of 120k. For consumers this equates to slightly more than $1/message input-only.

If ChatGPT is using this model then it's more reasonable to assume that they are bleeding money and need to cut costs.

People really need to stop asking ChatGPT to write out complete programs in a single prompt.

Re:Llamafile lets you distribute and run LLMs with a single ... by twobitshifter on Thursday November 30, 2023 @03:07PM (#38478400)
Interesting, how is writing less code cutting costs for them? Does this get back to the rumor that the board was mad at Altman for prioritizing chatgpt over money going into research/model training?
Re:Llamafile lets you distribute and run LLMs with a single ... by afpx on Friday December 01, 2023 @10:05AM (#38487525)
Code is very token dense, from what I understand.