News for hackers. Stuff that matters.
Re:OpenAI, Nvidia Fuel $1T AI Market with Web of Circular Deals by Ianjit on Thursday October 09, 2025 @03:07AM (#45524488)
I notice that when I ask ChatGPT a question the answers I get back seem more verbose than they were a year ago. Where a 1-2 line response would be sufficient GPT delivers a sprawling essay. Overall the value of the answer has probably gone down, but tokens are up.
Re:OpenAI, Nvidia Fuel $1T AI Market with Web of Circular Deals by noosphr on Thursday October 09, 2025 @06:07AM (#45525646)
You can quite easily ask it to summarize the result in a sentence or paragraph. LLMs have no other way to compute than write text and the more text they write the more compute they do. You only care about the final output.
Re:OpenAI, Nvidia Fuel $1T AI Market with Web of Circular Deals by Ianjit on Thursday October 09, 2025 @07:51AM (#45526340)
I do. It typically goes on to write a preamble about why it gave a long answer before finally providing a summary. Token stuffing.
Re:OpenAI, Nvidia Fuel $1T AI Market with Web of Circular Deals by noosphr on Thursday October 09, 2025 @04:39PM (#45532808)
This is akin to complaining about the overhead of radix conversion between decimal and binary in early computers.

Unless you figure out how to talk in latent space directly to an llm the preamble is the cost you pay for getting the answer back in English.

Re:OpenAI, Nvidia Fuel $1T AI Market with Web of Circular Deals by bmacho on Thursday October 09, 2025 @09:32AM (#45527470)
I've just set my (free) ChatGPT to "Robot" in style options, so far I like its style and level of detailedness