Also, the pricing is per token, so even with 4 it is close to negligible unless you are loading in a lot of context or your conversation gets very long.
So it might not be an option until 4 turbo comes out in 37 hours or whatever their development cycle is these days.
> GPT4 will have a dynamically adjusted usage cap. We expect to be severely capacity constrained, so the usage cap will depend on demand and system performance. API access will still be through the waitlist.
And then the actual 'sign-up' or marketing page before subscription didn't even say anything about getting GPT-4 (just about getting priority access to the standard chatgpt product).
Then at the bottom of each page above the box when you open GPT-4 as long as I remember it has always said something like "Current limit is this, capacity limits for GPT4 will be changed as we adjust for demand."
Right now it is a bit of a blocker because you can easily get a single prompt to cost you .005c - .01c, which would crush you if you ever had any kind of scale.
https://twitter.com/natfriedman/status/1639029709395886080?s...
In addition to being more expensive, GPT4 is a lot slower. For most casual things I use gpt3 and upgrade to GPT4 as needed. I've actually had a couple of days where I spent > $1 on GPT4. It's hard to do with every day chat, but easy to do when you get it to look/improve large amounts of code.
This is all from the API/CLI not the web interface.
Everyone wants this, but this is not the product.
The current AI offerings are information in --> information out.
It is not meant to keep state long term, and it is not meant to be your friend. It is meant to answer questions with the information available to it.
You can even see in the example screenshot they showcase the fact that it is not designed to be asked follow-up questions.
I have a long running conversation with ChatGPT that I use to keep track of a verbal to-do list. I tell it my items with categories (e.g. work, personal, etc.) and estimated times, and then it outputs my complete task list, grouped by category. I then just tell it when I add tasks or complete tasks, and it continually keeps track of and outputs my current outstanding task list.
I've been using this for weeks now, and since it's all in a single conversation ChatGPT can keep track of the entire state over time.
I don't have access to plugins yet but it would be trivial to implement a personal AI assistant with ChatGPT if it could, for example, look up flight times and prices.
I guess the question is, can we get ChatGPT to make that new list reliably?
https://platform.openai.com/docs/guides/chat - this API endpoint for completions doesn't take embeddings, just messages.
Their API docs for embeddings also don't talk about using them to get outside of the context size limit; instead, the way I've used it and seen others is "create embeddings from documents to enable fast search for relevant documents to populate in context" which still requires a separate data store.
Here's where I posted a snippet of this convo a couple weeks ago: https://news.ycombinator.com/item?id=35390644
It’s enough to keep a todo list going, it’s not enough to make it your friend / coworker
If you built what you were describing right now, either the flight questions would push out your todo list, or you would need to build something to keep state yourself.
To me, the greatest strength of LLMs is not their knowledge (which is prone to hallucination), but their ability to analyze ambiguous requests with ease and develop a sane action plan - much like a competent human.
One a side note: wouldn’t it be significantly cheaper and as effective to use ChatGPT 3.5 by default, and reserve GPT 4 for special tasks with explicit instruction (“Use GPT 4 to…”).
For most chats, GPT 4 would be incredibly wasteful (read: expensive).
Also - it would be very cool to experiment the use of GPT 3.5 and GPT 4 in the same conversation! GPT 3.5 could leverage the analysis of GPT 4 and act as the primary communication “chatbot” interface for addressing incremental requests.