News for hackers. Stuff that matters.
Re:OpenAI Shuts Down Chatbot Project by Indie Developer by ergot_vacation on Sunday September 12, 2021 @12:00PM (#28502302)
Thankfully the world is already moving on from these neanderthals. Eluther's GPT-J (https://6b.eleuther.ai/) isn't QUITE as good as GPT-3, but it's getting close, and was, as I understand it, much more efficient to create. This trend will likely continue, and within a year or two GPT-3 will be old news. Considering OpenAI has proved themselves to be vicious liars, greedy soulless fucks and pandering, censorial assholes, obsolescence couldn't happen to a nicer group.
Re:OpenAI Shuts Down Chatbot Project by Indie Developer by pitched on Sunday September 12, 2021 @12:07PM (#28502355)
It was the high cost per API call that pulled all the fun out of GPT-3 for me. I hadn’t been following the company at all but believe you based on just that single issue. It looks like GPT-J has open sourced their entire model so I could potentially run it myself for almost-free? If so, that’s going to be much more fun. Thanks for sharing!
Re:OpenAI Shuts Down Chatbot Project by Indie Developer by osmarks on Sunday September 12, 2021 @12:16PM (#28502450)
It's not exactly "almost free"; you need a powerful GPU, which are extremely costly right now. But apart from the cost of that and power, free.
Re:OpenAI Shuts Down Chatbot Project by Indie Developer by osmarks on Sunday September 12, 2021 @12:20PM (#28502482)
You can rent GPUs from various cloud providers, but those are hilariously expensive too even given datacentre GPU prices.
Re:OpenAI Shuts Down Chatbot Project by Indie Developer by pitched on Sunday September 12, 2021 @12:19PM (#28502468)
That thought was why I added “almost” right before posting! It’s free to run, just, except for the expensive parts... AWS still rents out GPU power, right? That might be a bit easier to get started with.
[dead]
Re:OpenAI Shuts Down Chatbot Project by Indie Developer by osmarks on Sunday September 12, 2021 @01:06PM (#28502861)
GNU/Linux requires basically the same hardware as the usual alternative (Windows). If you switch from hosted GPT-3 to selfhosted GPT-J you start needing to get and manage all the hardware, which might go underutilized most of the time depending on what your demand looks like, and which requires lots of software optimizations to use maximally effectively. You can use hosted GPT-J, though, a few companies offer that.
Re:OpenAI Shuts Down Chatbot Project by Indie Developer by bluesnowmonkey on Sunday September 12, 2021 @12:42PM (#28502666)
The comment to which you replied is making a useful point actually. Self hosting is not free in the relevant sense when comparing cost vs a third party API.
Re:OpenAI Shuts Down Chatbot Project by Indie Developer by karmasimida on Sunday September 12, 2021 @01:07PM (#28502867)
not possible, to run the original gpt3 model, you need at least 8 gpus to just hold all it parameters in memory
Re:OpenAI Shuts Down Chatbot Project by Indie Developer by reducesuffering on Sunday September 12, 2021 @02:08PM (#28503383)
"Be kind. Don't be snarky. Have curious conversation; don't cross-examine. Please don't fulminate. Please don't sneer, including at the rest of the community."

https://news.ycombinator.com/newsguidelines.html

Re:OpenAI Shuts Down Chatbot Project by Indie Developer by mdp2021 on Sunday September 12, 2021 @02:54PM (#28503729)
Name checks :)

The content is informative (within the poster's partial opinion) and the epithets can just be interpreted as colourful language to lighten up. Is it possible you interpreted it differently? In some cultures that post has the style intentionally used to elicit a warm laughter - styling is legitimate when applied to a valid (promoting "intellectual curiosity") content.

Re:OpenAI Shuts Down Chatbot Project by Indie Developer by SpicyLemonZest on Sunday September 12, 2021 @04:40PM (#28504691)
It's difficult to believe that there are cultures where calling people "vicious liars, greedy soulless fucks" is meant to be a light, playful comment.
Re:OpenAI Shuts Down Chatbot Project by Indie Developer by mdp2021 on Sunday September 12, 2021 @05:11PM (#28504987)
In many Western European areas that language is not necessarily impulsive flaming, but pondered qualifying with selected, honest terms.

The «playful» part is in your «light» unstirred pacified soul as you hammer out those heavy descriptive judgements.

Re:OpenAI Shuts Down Chatbot Project by Indie Developer by option_greek on Sunday September 12, 2021 @02:15PM (#28503444)
Too bad OpenAI doesn't allow free use of technology. Otherwise bots like above can be developed more easily.
Re:OpenAI Shuts Down Chatbot Project by Indie Developer by reducesuffering on Sunday September 19, 2021 @09:04PM (#28589435)
Again, care to read the literal guideline above? You're blatantly violating it.
Re:OpenAI Shuts Down Chatbot Project by Indie Developer by poorjohnmacafee on Sunday September 12, 2021 @02:16PM (#28503454)
They disappeared into their own fantasy land long ago. They announced that investors will have profit caps because their magical AGI will learn how to achieve infinite profit one day.

Statements like this must be remembered so that in the future we can point to this era's most ridiculous companies and the people behind them.

Re:OpenAI Shuts Down Chatbot Project by Indie Developer by Leparamour on Sunday September 12, 2021 @12:13PM (#28502425)
>Eluther's GPT-J (https://6b.eleuther.ai/)

Did this website receive HN's "hug-of-death"?

Re:OpenAI Shuts Down Chatbot Project by Indie Developer by osmarks on Sunday September 12, 2021 @12:19PM (#28502470)
Seems fine, just quite slow, as it says.
Re:OpenAI Shuts Down Chatbot Project by Indie Developer by schleck8 on Sunday September 12, 2021 @02:06PM (#28503366)
no, it's just expensive to run a 6 billion parameter model. the. limiting factor is the hardware