News for hackers. Stuff that matters.
Re:Genie 2: A large-scale foundation world model by miltonlost on Wednesday December 04, 2024 @01:27PM (#42320390)
> I want a Minecraft that tells intriguing stories with infinite quest generation. Procedural infinite world gen recharged gaming, where is the procedural infinite story generation?

You're not gonna get new intriguing stories from AI which only regurgitates what it's stolen. You're going to get a themeless morass without intention.

I also find it amusing how your example to Siri uses one of the oldest pieces of literature when you also tire of stories heard a thousand times before.

Re:Genie 2: A large-scale foundation world model by visarga on Wednesday December 04, 2024 @02:15PM (#42320923)
Actually, all you need to do is to apply structured randomness to get diversity from a LLM. For example in TinyStories paper, a precursor of the Phi models:

> We collected a vocabulary consisting of about 1500 basic words, which try to mimic the vocabulary of a typical 3-4 year-old child, separated into nouns, verbs, and adjectives. In each generation, 3 words are chosen randomly (one verb, one noun, and one adjective). The model is instructed to generate a story that somehow combines these random words into the story

You can do the same for generating worlds, just prepare good ingredients and sample at random.

Re:Genie 2: A large-scale foundation world model by miltonlost on Wednesday December 04, 2024 @02:21PM (#42320993)
A story is not just words crammed together that sound plausible. Is the AI going to know about pacing? About character motivations? About interconnecting disparate plots? That paper sounds like it has a scientist’s conception that a story is just words, and not complex trade offs between the start of a story and its end and middle, complexity and planning that won’t come from any sort of next-token generation.

These are “stories” in the most vacuous definition possible, one that is just “and then this happened” like a child’s conception of plot

Re:Genie 2: A large-scale foundation world model by wewtyflakes on Wednesday December 04, 2024 @05:20PM (#42322685)
> Is the AI going to know about pacing? About character motivations? About interconnecting disparate plots?

For LLMs like GPT-4, this all seems reasonable to account for and assume the LLM is capable of processing, given appropriate guidance/frameworks (of which may be just classical programming).

Re:Genie 2: A large-scale foundation world model by Philpax on Wednesday December 04, 2024 @06:17PM (#42323116)
> Is the AI going to know about pacing? About character motivations? About interconnecting disparate plots?

Yes. This is an active research area. See https://github.com/yingpengma/Awesome-Story-Generation, which is not up to date.

Re:Genie 2: A large-scale foundation world model by 93po on Wednesday December 04, 2024 @01:40PM (#42320522)
if you do basic chatgpt prompts in late 2024 asking for dynamic story telling, sure, you'll get what you said. it's super dismissive to think that wont get better over time, or that even with the tools today, that you can't get dynamic and interesting stories out of it if you provide it with the proper framework
Re:Genie 2: A large-scale foundation world model by krainboltgreene on Wednesday December 04, 2024 @02:15PM (#42320925)
> it's super dismissive to think that wont get better over time

When did we start thinking this way? That things HAVE to get better and in fact to think otherwise is very negative? Is HN under a massive hot hand fallacy delusion?

Re:Genie 2: A large-scale foundation world model by miltonlost on Wednesday December 04, 2024 @02:31PM (#42321100)
Lots of people want that AI grift money and need to be pollyanna true believers to convince others that models that don't know truth are useful decision makers
Re:Genie 2: A large-scale foundation world model by rjrdi38dbbdb on Wednesday December 04, 2024 @07:20PM (#42323509)
How could creativity in AI not get better?

Sure, progress will likely not be linear or without challenges, but we already have the human brain as proof that it is possible.

Re:Genie 2: A large-scale foundation world model by fwip on Wednesday December 04, 2024 @08:23PM (#42323861)
Mountains exist, but that doesn't mean we'll ever build a structure the size of Everest.
Re:Genie 2: A large-scale foundation world model by rjrdi38dbbdb on Thursday December 05, 2024 @04:55AM (#42326602)
If you compare the historical rate of improvements in computing power and algorithms vs rate of improvements in building scale, you'll find one is a whole lot more likely to reach its goal, even if the rate of progress slows significantly.
Re:Genie 2: A large-scale foundation world model by krainboltgreene on Thursday December 05, 2024 @03:50PM (#42332591)
There is absolutely no evidence to suggest one of these is more likely within reach. We at least know how Mt. Everest works.
Re:Genie 2: A large-scale foundation world model by krainboltgreene on Thursday December 05, 2024 @03:50PM (#42332602)
You're saying AI, the parent I'm replying to is talking about ChatGPT. They aren't the same thing.
Re:Genie 2: A large-scale foundation world model by whamlastxmas on Thursday December 05, 2024 @04:37PM (#42333061)
ChatGPT is a product that exists beyond just LLMs and I do use it synonymously with natural language interface AI
Re:Genie 2: A large-scale foundation world model by krainboltgreene on Thursday December 05, 2024 @05:35PM (#42333619)
No it doesn't and no one else does so you're going to be really confusing in conversations.