News for hackers. Stuff that matters.
Re:AI is now capable of developing its own inference hardware by _heimdall on Tuesday October 06, 2026 @03:11PM (#49982701)
I'm not sure how you'd land on an LLM being unable to invent anything new. You'd have to both understand exactly what LLMs are and aren't capable of today and what allows human creativity. I don't think there are good answers to either.

It seems unlikely that recursively predicting the next word would lead to creativity or invention, but it doesn't seem impossible. Similarly, it seems unlikely that human thought works in a similar prediction loop, but it doesn't seem impossible.

Re:AI is now capable of developing its own inference hardware by r14c on Tuesday October 06, 2026 @03:20PM (#49982800)
Human ingenuity is creative by definition, that's where the concept arises. The burden of proof is on AI labs to prove that their models are rising to the level of actual synthesis, rather than very impressive 200-level regurgitation that looks like synthesis if you squint a bit; because the model has access to more raw data than your average sophomore student.
Re:AI is now capable of developing its own inference hardware by ben_w on Tuesday October 06, 2026 @03:39PM (#49983020)
> Human ingenuity is creative by definition, that's where the concept arises

Sure, but until we can turn that tautology into something more rigorous, we can't tell if the thing humans do is more or less than what some arbitrary non-human (machine, animal, or eventually perhaps alien) does.

Re:AI is now capable of developing its own inference hardware by r14c on Tuesday October 06, 2026 @08:37PM (#49986311)
Its not a logical tautology, we just don't have other examples. We know that even humans have to clear a well defined bar to synthesize new information. The challenge is actually proving that the LLM isn't merely surfacing obscure data. The mechanism is interesting, but not actually necessary for this exercise.
Re:AI is now capable of developing its own inference hardware by _heimdall on Wednesday October 07, 2026 @11:22PM (#50001577)
Its tautological because you defined it by human ingenuity, and that's only known based on us knowing what its like to be human. Of course another species has yet to seem from the outside like they present human ingenuity or experience life similar to us.

That has nothing to do with creativity as its own concept. Its creative to invent flight similar to the Wright brothers. Its also creative to use a stick to get termites from their nest or come up with new techniques for hunting pray.

Re:AI is now capable of developing its own inference hardware by _heimdall on Tuesday October 06, 2026 @08:18PM (#49986141)
That goes in circles though.

Ignore the fact that we are human and thing our ingenuity is unique. Is definitionally linking human ingenuity and creativity useful when trying to compare to others?

I could say earth is habitable so any other planet must prove it is similar to earth to be habitable. That simply doesn't matter, though, if different environments could lead to similarly complex living systems regardless of atmospheric makeup, precense of liquid water, etc.

I'd argue the burden is on you to prove that the definition you propose is meaningful beyond our own hubris, rather than expecting an alternative to now have to prove that the hubris was unjustified.