News for hackers. Stuff that matters.
Re:GPT-4 Details Leaked by KronisLV on Tuesday July 11, 2023 @01:47AM (#36676851)
> You can use the above without paying OpenAI. You don't even need a GPU. There are no license issues like with the facebook llama.

I actually wrote about getting an LLM chatbot up and running a while ago: https://blog.kronis.dev/tutorials/self-hosting-an-ai-llm-cha...

It's good that the technology and models are both available for free, and you don't even need a GPU for it. However, there are still large memory requirements (if you want output that makes sense) and using CPU does result in somewhat slower performance.

There are async use cases where it can make sense, but for something like autocomplete or other near real time situations we're not there yet. Nor is the quality of the models comparable to some of the commercial offerings, at least not yet.

So I don't have it in me to blame anyone who forks over the money to a SaaS platform instead of getting a good GPU/RAM and hosting stuff themselves.

Here's hoping the more open options keep getting better and more competitive, though!

Re:GPT-4 Details Leaked by antupis on Tuesday July 11, 2023 @02:04AM (#36676958)
I bet that open models win in the end because porn. There is already very weird and vibrant community creating "waifus" and tinkering with these models.
Re:GPT-4 Details Leaked by KronisLV on Tuesday July 11, 2023 @02:30AM (#36677130)
Huh, more power to those folks then, I guess.

But I can easily imagine more conventional forms of entertainment, as well. Like a game of D&D that's narrated by the AI, or a text based adventure set in the Mass Effect universe, Lord of the Rings, Warhammer or any other fandom, really. Maybe like those old Choose Your Own Adventure games.

I think some companies are also experimenting with characters in video games that get their dialogue from these models - where the developers give the character a persona, provide information about events in the world and let players interact with them, like the Detective Origins demo. Of course, due to the slightly unpredictable nature of these models and their hardware requirements, no idea how viable this will be.

Re:GPT-4 Details Leaked by mahathu on Tuesday July 11, 2023 @02:58AM (#36677349)
The application in games I'm most excited about is commenters in FIFA career mode that don't have a limited set of prerecorded voice lines, and ones that take your recent games (the recent installments already do, to a small degree), formation changes etc into account too, like real commentators would. Of course this would also easily open the doors to having multiple commentators/analysts to choose from, each with their individual "personalities". The technology for that is pretty much all already there right?

A game like Fallout/Elder Scrolls with AI generated NPCs and questlines would be so sick too if executed well.

Re:GPT-4 Details Leaked by Al0neStar on Tuesday July 11, 2023 @03:39AM (#36677657)
Maybe for side quests but even that would be a debug hell.
Re:GPT-4 Details Leaked by hovering_nox on Tuesday July 11, 2023 @03:47AM (#36677723)
There is a mod for Skyrim where someone piped together multiple AI models. It goes like this: You speak into your microphone and ask a NPC something. This gets transcribed (voice to text) by Whisper AI. This transcript gets send to eg. GPT-4 with a pre-prompt engineered to give background, current information and the "personality" for the NPC you are talking to. The output of this gets piped back to a Text-to-Speech solution like eleven-labs with the original NPC voice.
Re:GPT-4 Details Leaked by hoseja on Tuesday July 11, 2023 @04:09AM (#36677878)
I've seen an example and the weakest link seemed to be the TTS, which sounded several generations behind.
Re:GPT-4 Details Leaked by potatototoo99 on Tuesday July 11, 2023 @04:26AM (#36677998)
Do you seriously think D&D and other choose your adventure games will be more popular than porn? Seriously?
Re:GPT-4 Details Leaked by DeathArrow on Tuesday July 11, 2023 @05:47AM (#36678574)
If they also include porn, maybe.
Re:GPT-4 Details Leaked by immibis on Tuesday July 11, 2023 @10:32AM (#36681514)
Did you try AI Dungeon before OpenAI killed it?

Yes, people used it for porn.

Re:GPT-4 Details Leaked by immibis on Tuesday July 11, 2023 @10:34AM (#36681552)
You are describing AI Dungeon, a third-party product using GPT-3 that OpenAI killed about two years ago.
Re:GPT-4 Details Leaked by hoseja on Tuesday July 11, 2023 @04:08AM (#36677872)
The (even pre-emptive!) opposition and censorship seems way stronger this time around than with previous technologies. Like instead of ignoring the porn (or even profiting from it), they are trying very hard to make it impossible.
Re:GPT-4 Details Leaked by DeathArrow on Tuesday July 11, 2023 @05:47AM (#36678570)
Porn will save the world again!
Re:GPT-4 Details Leaked by yyyk on Tuesday July 11, 2023 @05:57AM (#36678659)
Perhaps this could happen to make Stable Diffusion win against Midjourney/Adobe. LLMs however have more than enough commercial support to overcome weird communities, and these communities care less about text than images.
Re:GPT-4 Details Leaked by rurp on Tuesday July 11, 2023 @11:22AM (#36682273)
Porn could definitely be a killer app for LLMs, and I strongly hope that open source models win out for a number of reasons, but I'm not sure it will happen. Microsoft and OpenAI have quickly gone to great lengths to try and limit the amount of output they find offensive, and those efforts have been fairly well received by the general public.

Despite the size of the regular online porn industry, it still gets strangled by payment processors. There is plenty of appetite out there for restricting porn in various ways.

Re:GPT-4 Details Leaked by stOneskull on Tuesday July 11, 2023 @02:37PM (#36685374)
> Microsoft and OpenAI have quickly gone to great lengths to try and limit the amount of output they find offensive, and those efforts have been fairly well received by the general public.

it offends me. i think many find this neutering annoying. and many more will. i think bing chat is fine this way, and for the general public, but if i'm paying to access the gpt api, there should be an uncensored version. i'm an adult. i can handle 'offensive' things. it's offensive telling me i'm not allowed to see 'offensive' things.