News for hackers. Stuff that matters.
Re:GPT4 is up to 6 times more expensive than GPT3.5 by Der_Einzige on Tuesday March 14, 2023 @06:22PM (#35159898)
The fundamental techniques that they use are highly lossey and are far inferior to ultra-long context length models where you can do it all in one prompt. Hate to break it to you and all the others.
Re:GPT4 is up to 6 times more expensive than GPT3.5 by hombre_fatal on Tuesday March 14, 2023 @06:39PM (#35160141)
> Hate to break it to you and all the others.

Jeez. Their comment is quite obviously a complementary one in response to the limitation rather than a corrective one about the limitation.

Re:GPT4 is up to 6 times more expensive than GPT3.5 by nico on Tuesday March 14, 2023 @06:35PM (#35160098)
Where can someone find and try ultra-long context length models?

Any links?

Re:GPT4 is up to 6 times more expensive than GPT3.5 by intelVISA on Tuesday March 14, 2023 @06:42PM (#35160197)
The longest one that is generally available is always going to be yourself :)
Re:GPT4 is up to 6 times more expensive than GPT3.5 by thelittleone on Tuesday March 14, 2023 @06:57PM (#35160440)
My context model is getting shorter and fuzzier.
Re:GPT4 is up to 6 times more expensive than GPT3.5 by EntrePrescott on Tuesday March 14, 2023 @08:10PM (#35161624)
… but still the weights are increasing ;)
Re:GPT4 is up to 6 times more expensive than GPT3.5 by faizshah on Tuesday March 14, 2023 @07:23PM (#35160922)
The methods they employ are to improve the context being given to the model irrespective of the context length. Even when the context length improves these methods will be used to decrease the search space and resources required for a single task (think about stream search vs indexed search).

I’m also curious what paper you are referencing that finds that more context vs more relevant context yields better results?

A good survey of the methods for “Augmented Language Models” (CoT, etc.) is here: https://arxiv.org/pdf/2302.07842.pdf