News for hackers. Stuff that matters.
Re:GPT-4 API General Availability by athyuttamre on Thursday July 06, 2023 @04:26PM (#36622381)
(I'm an engineer at OpenAI)

Very sorry to hear about these issues, particularly the timeouts. Latency is top of mind for us and something we are continuing to push on. Does streaming work for your use case?

https://github.com/openai/openai-cookbook/blob/main/examples...

We definitely want to investigate these and the billing issues further. Would you consider emailing me your org ID and any request IDs (if you have them) at [email protected]?

Thank you for using the API, and really appreciate the honest feedback.

Re:GPT-4 API General Availability by renewiltord on Thursday July 06, 2023 @04:28PM (#36622438)
Quick note: your domain doesn't appear to have an A record. I was hoping to follow the link in your profile and see if you have anything interesting written about LLMs.
Re:GPT-4 API General Availability by athyuttamre on Thursday July 06, 2023 @04:30PM (#36622471)
Thanks! The website is no longer active, just updated my bio.
Re:GPT-4 API General Availability by henry_viii on Thursday July 06, 2023 @05:00PM (#36622952)
I know you guys are busy literally building the future but could you consider adding a search field in ChatGPT so that users can search their previous chats?
Re:GPT-4 API General Availability by danenania on Thursday July 06, 2023 @06:02PM (#36623751)
I'd also love to see a search field. That's my #1 feature request not related to the model.
Re:GPT-4 API General Availability by glintik on Thursday July 06, 2023 @04:42PM (#36622663)
> We definitely want to investigate these and the billing issues further. What’s a problem for OpenAI engineers to get web access logs and grep for 4xx/5xx errors?
Re:GPT-4 API General Availability by esperent on Thursday July 06, 2023 @04:50PM (#36622798)
It's kind of incredible how fast OpenAI (now also known as ClosedAI) is going through the enshittification process. Even Facebook took around a decade to reach this level.

OpenAI has an amazing core product, but in the span of six months:

* Went from an amazing and inspiring open company that even put "Open" in their name to a fully locked up commercial beast.

* Non-existent customers support and all kinds of borderline illegal billing practice. You guys are definitely aware that when there's a network error on the API or ChatGPT, the user still gets charged. And there's a lot of these errors. I get roughly one per hour or two.

* Frustratingly loose interpretation of EU data protection rules. For example, the setting to say "don't use my personal chat data" is connected to the setting to save conversations. So you can't disable it without losing all your chat history.

* Clearly nerfing the ChatGPT v4 products, at least according to hundreds or even thousands of commenters here and on reddit, while denying to have made any changes.

* Use of cheap human labor in developing countries through shady anonymous companies (look up the company Sama who pay Kenyan workers about $1.5 an hour).

* Not to mention the huge questions around the secret training dataset and whether large portions of it consist of illegally obtained private data (see the recent class court case in California)

Re:GPT-4 API General Availability by km3r on Thursday July 06, 2023 @05:07PM (#36623058)
> Use of cheap human labor in developing countries through shady anonymous companies (look up the company Sama who pay Kenyan workers about $1.5 an hour).

What is wrong about injecting millions into developing nations?

The rest I agree with, although I don't think it was ever really 'open' so its not getting shitty, it always was. Thankfully, "there is no moat" and other LLMs will be open, just a few months behind OpenAI

Re:GPT-4 API General Availability by esperent on Thursday July 06, 2023 @08:45PM (#36625475)
> What is wrong about injecting millions into developing nations?

Please don't try to reframe this to make exploitation a positive thing. See my other comment here.

https://news.ycombinator.com/item?id=36625438

Re:GPT-4 API General Availability by km3r on Thursday July 06, 2023 @10:32PM (#36626328)
So you'd rather OpenAI crush all business in the area by outcompeting them for workers, ensuring local businesses struggle to hire?
Re:GPT-4 API General Availability by kossTKR on Thursday July 06, 2023 @05:43PM (#36623505)
Since chatGPT-4 is now useless for advanced coding because of their blackbox sudden nerfing, can anyone guess how long before i can run something similar to the orig version privately?

Is the newer 64B models up there? 1 year, 2 years? Can't wait until i get back the crazy quality of the orig model.

We need something open source fast. Thanks open-ai for giving us a glimpse of the crazy possibilities, too crazy for the public i guess.

Re:GPT-4 API General Availability by tarruda on Thursday July 06, 2023 @05:45PM (#36623522)
The engineer is not part of the board which makes these decisions.
Re:GPT-4 API General Availability by lmm on Thursday July 06, 2023 @07:24PM (#36624719)
If they're taking their time to defend the company on the internet, they either have an ownership stake in it or they're a chump.
Re:GPT-4 API General Availability by esperent on Thursday July 06, 2023 @08:41PM (#36625447)
Or option 3, they're being paid to represent sneakily represent the company in a positive light.
Re:GPT-4 API General Availability by SergeAx on Friday July 07, 2023 @11:15AM (#36632987)
They may defend the product, not the company. It is normal for engineers to be emotionally invested in their products.
Re:GPT-4 API General Availability by astrange on Thursday July 06, 2023 @08:08PM (#36625150)
> * Use of cheap human labor in developing countries through shady anonymous companies (look up the company Sama who pay Kenyan workers about $1.5 an hour).

If you pay a developing country developed country wages what you'll get is 1. inflation and 2. the government mad at you because all their essential workers/doctors/government officials are quitting to work for you.

Re:GPT-4 API General Availability by esperent on Thursday July 06, 2023 @08:40PM (#36625438)
* * *
Re:GPT-4 API General Availability by astrange on Thursday July 06, 2023 @10:11PM (#36626144)
OpenAI doesn't pay minimum wages, they pay around the median local wage IIRC. I wouldn't say that if it was minimum wage.
Re:GPT-4 API General Availability by hnfong on Thursday July 06, 2023 @10:29PM (#36626290)
I'm curious. When you buy a loaf of bread from the local market, are they cheaper than first world prices? If so, do you pay double the listed price and demand the shop pay double the price to hire workers so as to not exploit them? Are your expenses in said developing country lower than what you would have paid if you were in a richer country? Are you donating the difference to the local community?

Just curious.

Re:GPT-4 API General Availability by esperent on Thursday July 06, 2023 @11:14PM (#36626622)
It's weird how people always trot out phrases like "I'm just curious" or "I'm just asking questions here" when they try to justify exploitation. Is it so that you have plausible deniability when you inevitably get called on it? Because that doesn't work.
Re:GPT-4 API General Availability by hnfong on Friday July 07, 2023 @10:25AM (#36632236)
I see that you have pretty extreme takes on what constitutes "exploitation". It's one thing to pretend that you're not part of it if you live on another part of the planet and pretend globalization doesn't exist, but I was wondering how you'd avoid participating in it if you lived in the same country and economic bubble as the ones you claim are exploited.

If you had a morally consistent way to live that life, you'd have my respect. But no, you had to deflect the topic to a phrase I wrote and make presumptions about what I really meant.

FYI, I'm morally at ease with myself, I don't need to justify anything to anyone.

Re:GPT-4 API General Availability by davedx on Friday July 07, 2023 @03:48AM (#36628545)
Hi, I've been to Kenya and Tanzania, and while basic staples are cheaper than developed countries they're not that much cheaper these days. If you watch travelog videos where they ask locals how they're doing, many developing countries are struggling with massive inflation that's been partly caused by volatile energy prices (many people can no longer afford gas) and partly by food shortages from the Ukraine War.
Re:GPT-4 API General Availability by fragmede on Thursday July 06, 2023 @08:11PM (#36625179)
Not to nitpick, but if you're able to name the company employing Kenyans, Sama, who's homepage is at https://www.sama.com/, with a team page at https://www.sama.com/our-team/ , I'm not sure you can complain that they're being shady and anonymous.
Re:GPT-4 API General Availability by esperent on Thursday July 06, 2023 @08:30PM (#36625338)
It's pretty shady. They have been fully exposed at this stage but from what I understand they were trying to keep a very low profile, going to efforts to make sure the Kenyan workers didn't know they were working for a company called Sama but instead using sub companies to sign the worker contracts.

https://time.com/6247678/openai-chatgpt-kenya-workers/

Re:GPT-4 API General Availability by dontupvoteme on Friday July 07, 2023 @07:47AM (#36630265)
They also no longer support data exports for many users (including myself) - at one point it worked but now it says you'll receive an email to download your data, which never arrives.
Re:GPT-4 API General Availability by DomKM on Thursday July 06, 2023 @07:45PM (#36624943)
While you're here, you should know that the logic for enabling GPT-4 API access is excluding Microsoft for Startups (https://openai.com/microsoft-for-startups) orgs which have valid billing against Microsoft-provided credits. Presumably, this is an oversight as it wouldn't make sense to exclude pre-existing Microsoft partners. Would you mind escalating this?
Re:GPT-4 API General Availability by athyuttamre on Thursday July 06, 2023 @08:04PM (#36625109)
Thanks for pointing this out. Sharing with the relevant folks.
Re:GPT-4 API General Availability by jiggawatts on Friday July 07, 2023 @04:47AM (#36629011)
This is precisely what is wrong with OpenAI. This. Right here.

"Complaining on HN will get you access. You have know people or "complain in the right forums."

THERE SHOULD BE NO LOGIC.

No qualifying rules. No access checks. No gates. No hoops.

Sam Altman has gone on a worldwide interview tour claiming he wants to "democratise access to AI", meanwhile OpenAI is the least open company I have ever dealt with, or even heard of.

Oracle is more "democratic" and open, for crying out loud.

Re:GPT-4 API General Availability by jwr on Friday July 07, 2023 @05:13AM (#36629175)
Streaming has no value for me, I need the entire response before I can do anything. I looked at streaming, but it seemed like a significant effort to implement, and with no obvious benefit — if I get 75% of my response through streaming and then something breaks, it doesn't get me anywhere.

Thanks for offering help, I will contact you directly.