News for hackers. Stuff that matters.
Re:The bigger-is-better approach to AI is running out of road by Animats on Saturday June 24, 2023 @05:06PM (#36462654)
We need a way to make tight little specialist models that don't hallucinate and reliably report when they don't know. Trying to cram all of the web into a LLM is a dead end.
Re:The bigger-is-better approach to AI is running out of road by rco8786 on Saturday June 24, 2023 @05:22PM (#36462763)
Bingo. I've been beating this drum since the initial GPT-3 awe.. The future of AI is bespoke, purpose-driven models trained on a combination of public and (importantly) proprietary data.

Data is still king.

Re:The bigger-is-better approach to AI is running out of road by JimtheCoder on Saturday June 24, 2023 @05:29PM (#36462813)
So, search isn't dead after all...
Re:The bigger-is-better approach to AI is running out of road by stavros on Saturday June 24, 2023 @05:37PM (#36462876)
Search has definitely been dead since before LLMs, we just don't have a replacement yet.
Re:The bigger-is-better approach to AI is running out of road by JimtheCoder on Saturday June 24, 2023 @05:39PM (#36462885)
I mean more the concept of search, not the current implementation
Re:The bigger-is-better approach to AI is running out of road by stavros on Saturday June 24, 2023 @05:40PM (#36462891)
Oh, I don't think we'll ever stop wanting to search for things. Maybe not everything, but some things.
Re:The bigger-is-better approach to AI is running out of road by imtringued on Sunday June 25, 2023 @07:46AM (#36467214)
Search is about finding existing results. The opposite of search is to start from first principles and work your way up until you have created the desired result yourself.

In the real world, search reduces information acquisition costs as you only have to spend time and resources on finding an existing result rather than recreating it.

Re:The bigger-is-better approach to AI is running out of road by BolexNOLA on Saturday June 24, 2023 @06:23PM (#36463174)
For a while my replacement was “use google, add ‘reddit’ at the end.” Not sure how much longer that will work given even just this limited blackout impacted how effective that was lol
Re:The bigger-is-better approach to AI is running out of road by edgyquant on Saturday June 24, 2023 @06:43PM (#36463303)
That hasn’t worked since about three months after companies found out people do it. It’s all astroturfing now days anyway and if it applies to products (which it for sure does) you can be sure that government actors caught on as well.
Re:The bigger-is-better approach to AI is running out of road by mitchdoogle on Saturday June 24, 2023 @07:28PM (#36463657)
I'm not really sure what you're saying. It seems to me the number of shills creating content is vastly outnumbered by normal people creating content, so the trick of adding "reddit" to the end of queries is still very much useful (blackout protests aside) since it's usefulness derives from getting information from normal people and then having normal people upvote the "best" comments. Just the other day I tried this with data recovery software very quickly found some free software that was highly praised. If I had just searched "data recovery software" on Google I get whichever data recovery place as the best SEO, including many of them who claim that a novice should be trying it at all and should use their services pronto. Using reddit in this case gave me the exact information I wanted, where Google alone was next to useless.
Re:The bigger-is-better approach to AI is running out of road by BolexNOLA on Saturday June 24, 2023 @10:28PM (#36464645)
Yeah I don’t know their experience, but mine is when I add “Reddit” i often get 2-3 threads talking about the exact thing I’m looking up in the top 10 results.
Re:The bigger-is-better approach to AI is running out of road by edgyquant on Sunday June 25, 2023 @01:22PM (#36470580)
What I’m getting at is that those threads have a high likelihood of being gamed to make you think a certain way
Re:The bigger-is-better approach to AI is running out of road by quesera on Saturday June 24, 2023 @09:57PM (#36464491)
I'm not sure if it would help or restore the kinds of results you were seeing previously, but instead of adding "reddit", you can add "site:reddit.com" to get only results from that site. (Originally a Google feature, but works on Duck Duck Go also. Not sure about others.)

Unless you mean that Reddit is astroturfed with the SEO garbage you're trying to avoid, in which case this will definitely not help.

Is search on Reddit itself still useless?

Re:The bigger-is-better approach to AI is running out of road by BolexNOLA on Saturday June 24, 2023 @10:26PM (#36464642)
Search on Reddit several years ago went from “useless” to I don’t know…a C-? It can work.
Re:The bigger-is-better approach to AI is running out of road by edgyquant on Monday June 26, 2023 @10:53AM (#36480366)
Yeah I mean it’s astroturfed and likely in ways beyond just corporate
Re:The bigger-is-better approach to AI is running out of road by samstave on Saturday June 24, 2023 @06:24PM (#36463185)
It will be a terrific moment when we can browse a galaxy map or other lists of LLMs, and select "context" groups - so you can say from history, give me X
Re:The bigger-is-better approach to AI is running out of road by thelittleone on Saturday June 24, 2023 @06:29PM (#36463209)
That doesn't sound ideal at all to me. It also sounds like a bottleneck. I want to ask AI once and it recommends or selects the best "context" group.
Re:The bigger-is-better approach to AI is running out of road by samstave on Saturday June 24, 2023 @06:59PM (#36463439)
It would bea good visual training tool for kids so they can get an understanding early on other than a block-box view.
Re:The bigger-is-better approach to AI is running out of road by danielvaughn on Saturday June 24, 2023 @07:19PM (#36463600)
I’d be really interested to see an AI model built off of Sci Hub data.
Re:The bigger-is-better approach to AI is running out of road by fooker on Saturday June 24, 2023 @09:34PM (#36464384)
Facebook announced this a month or so before chatgpt took off, and got lambasted everywhere because of hallucinations.
Re:The bigger-is-better approach to AI is running out of road by croes on Saturday June 24, 2023 @09:20PM (#36464319)
This would only work if thinks like GPT were actually intelligent.

Train on dataset A to learn to think, use thinking on dataset B to become an export in B's field.

Re:The bigger-is-better approach to AI is running out of road by Animats on Sunday June 25, 2023 @12:34AM (#36465164)
You need sort of a "primary education" data set which gets the model up to roughly a high school education level. Then augment it with special-purpose models for specific areas.

But until "I don't know" comes out, rather than hallucinations, we're in trouble.

Re:The bigger-is-better approach to AI is running out of road by rco8786 on Sunday June 25, 2023 @08:03AM (#36467325)
> You need sort of a "primary education" data set which gets the model up to roughly a high school education level.

Yea that was what I was getting at with the "combination" of data. The publicly available data provides the base/primary education, then you specialize it with your proprietary data and bam, you have an AI model that nobody else can produce...an actual product moat.

Re:The bigger-is-better approach to AI is running out of road by causalmodels on Saturday June 24, 2023 @05:35PM (#36462865)
It's not an either or. We're going to leverage the web trained LLMs to bootstrap the specialist models via combination of training token quality classifiers and synthetic data generation. Phi-1 is a pretty good example of this.
Re:The bigger-is-better approach to AI is running out of road by z3c0 on Saturday June 24, 2023 @05:13PM (#36462703)
Logistic Regression is simple to implement, supports binomial, multinomial, and ordinal classification, and is a key layer in NN, as it's often used as an actuator that sorts a probability into a discrete category. Very good for specialized problems, and easily trainable to sort unknown or nonsensical outputs into a noncategory.

Linear Regression is great for projections, and can even be fit to time series data using lagging.

Re:The bigger-is-better approach to AI is running out of road by TX81Z on Saturday June 24, 2023 @05:42PM (#36462908)
GPT4 is really good at code and you can generally verify hallucination easily.

The other good use cases are using LLM to turn natural language prompts into API calls to real data.

Re:The bigger-is-better approach to AI is running out of road by LASR on Saturday June 24, 2023 @05:48PM (#36462945)
This is what I've been doing. GPT-4 to generate some data from some input, followed up by a 3.5T call to verify the output against the input to verify the content. You can feed the 3.5T output straight back into GPT-4 again and it will self-correct.

Doing this a couple of times gives me 100% accuracy for my use case that involves some level of summarization and reasoning.

Hallucinations are not as big of a deal at all IMO. Not enough that I'll just sit there and wait for models that don't hallucinate.

Re:The bigger-is-better approach to AI is running out of road by adriand on Saturday June 24, 2023 @06:44PM (#36463311)
This sounds interesting, can you detail this data flow a bit more and maybe provide an example?
Re:The bigger-is-better approach to AI is running out of road by simion314 on Saturday June 24, 2023 @06:12PM (#36463119)
>GPT4 is really good at code

for popular languages, though for JS it most of the time outputs obsolete syntax and code.

Today i tried to do a bit of scripting with my son in Garrys Mod, it uses Expression 2 for a Wiremod module. GPT hallucinated a lot of functions and the worst part it switched almost each time from e2 to lua.

It is good at solving homeworks for students, or solving popular problems in popular languages and libraries though it might give you an ugly solution and ugly code, it is probably trained on bad code too and it did not learn to prefer good code over bad code.

Re:The bigger-is-better approach to AI is running out of road by TX81Z on Sunday June 25, 2023 @02:46AM (#36465630)
I’ve been writing JavaScript for 25 years and have always felt it has utterly trash syntax. I’m not sure that’s 100% on GPT.

(And I don’t mean to be rude - I just really hate that syntax!)

Re:The bigger-is-better approach to AI is running out of road by simion314 on Sunday June 25, 2023 @04:41AM (#36466142)
What I mean it will generate code using var instead of let or const like instead of a nice array.forEach it will create for(var i

i mean use at least "let"

Re:The bigger-is-better approach to AI is running out of road by TX81Z on Sunday June 25, 2023 @03:07PM (#36471546)
Yeah, same point I’m making - what other language declares variables like that? It’s a mess!
Re:The bigger-is-better approach to AI is running out of road by skepticATX on Saturday June 24, 2023 @05:47PM (#36462939)
This is ultimately just very powerful semantic search though, is it not?

It seems that what we need to make a big leap forward is better reasoning. There is a lot of debate between the GPT-4 can/can't reason camps, but I haven't seen anyone try to argue that it reasons particularly well.

Re:The bigger-is-better approach to AI is running out of road by imtringued on Sunday June 25, 2023 @07:55AM (#36467269)
It shouldn't even be that difficult to build it. Modus ponens and good theorems are all you need.

Building the data set for that should be quite trivial.

Re:The bigger-is-better approach to AI is running out of road by og_kalu on Saturday July 01, 2023 @04:17PM (#36554654)
You can easily argue 4 reasons particularly well, especially with average human performance as the baseline.

People who argue against GPT-4 reasoning at all are arguing against clear results. It extremely easy to show examples and benchmarks of 4 reasoning and understanding. The argument then turns into "well that's not "true" reasoning", whatever that means.

Re:The bigger-is-better approach to AI is running out of road by wilg on Saturday June 24, 2023 @05:52PM (#36462974)
How are we determining it's a dead end here? Recently things like GPT-4 have come out which have improved on that technique. Why would specialization necessarily reduce hallucination and improve accuracy?
Re:The bigger-is-better approach to AI is running out of road by brucethemoose2 on Saturday June 24, 2023 @06:00PM (#36463037)
Its complicated.

Training on something huge like "the internet" is what gives rise to those amazing emergent properties missing in smaller models (including the recent Pi model). And there are only so many datasets that huge.

But its also indeed a waste, as Pi proves.

There probably is some sweet spot (6B-40B?) for specialized, heavily focused models pre trained with high quality general data.

Re:The bigger-is-better approach to AI is running out of road by TeMPOraL on Saturday June 24, 2023 @06:03PM (#36463065)
How much general "thinking"[0] would you want those "tight little specialist models" to retain? I think that cramming "all of the web" is actually crucial for this capability[1], so at least with LLM-style models, you likely can't avoid it. The text in the training data set doesn't encode just the object-level knowledge, but indirectly also higher-level, cross-domain and general concepts; cutting down on the size and breadth of the training data may cause the network to lose the ability to "understand"[0].

--

[0] - Or "something very convincingly pretending to think by parroting stuff back", if you're closer to the "stochastic parrot" view.

[1] - Per my hand-wavy hypothesis that the bulk of what we call thinking boils down to proximity search in extremely high-dimensional space.

Re:The bigger-is-better approach to AI is running out of road by nathan_compton on Saturday June 24, 2023 @07:15PM (#36463563)
This is basically my view as an extensive gpt4 user. It doesn't think/is very stupid, but has such fantastic recall for common patterns that its quite useful. Absolutely none of the smaller models even come close, including GPT3.5.
Re:The bigger-is-better approach to AI is running out of road by jiggawatts on Saturday June 24, 2023 @07:41PM (#36463759)
Even just for spell checking, having a ton of general knowledge helps. Knowing the correct spelling of product names, British vs American English, context-specific alternate spellings, etc…
Re:The bigger-is-better approach to AI is running out of road by thfuran on Sunday June 25, 2023 @09:08AM (#36467836)
Can you not just tell it not to muck with proper nouns?
Re:The bigger-is-better approach to AI is running out of road by jiggawatts on Sunday June 25, 2023 @07:15PM (#36473645)
You can, but then it won't correct misspellings of proper nouns!

The idea is for it to automatically detect the "language" of each word based on the context and its own understanding of the world.

E.g., the following sentence:

"We deployed windows server data centre 2022 into our data center, which has no windows for physical security."

Will be corrected by GPT-4 to the following:

"We deployed Windows Server Datacenter 2022 into our data centre, which has no windows for physical security."

Notice that it combined "data" and "centre" into "Datacenter" and it corrected the second "center" into "centre", which is the British/Australian spelling of the word. It also correctly capitalised only the first use of the word "windows", etc...

That requires a level of understanding that GPT 3.5 just barely has, and no ordinary grammar checker tool has.

Re:The bigger-is-better approach to AI is running out of road by jstarfish on Saturday June 24, 2023 @07:44PM (#36463772)
There are boundaries that can be defined, but I'm unclear on what those should be. I'm thinking breaking it down by semantic domains, but not at the exclusion of others altogether-- just heavily weigh certain domains in favor of others. Kinda like how StackOverflow is broken down by domain-- each subdomain could be a LORA or something.

General purpose models containing significant overlap between Project Gutenberg and Github are unnecessary and don't scale. Moby Dick has little to do with C++ unless you're creating art for novelty's sake. This is entirely speculative, but I'm convinced ChatGPT is faking the appearance of a single oracle while delegating requests to specialized models under the hood. It scales better and makes sense than trying to serve a 1T model to address everybody's banal questions.

Like, at its core, for people who only want to write literature, give them a model with underweighed programming-related corpora. Writers don't need it, will never use it, and that space could be filled with training content relevant to literature. Anything else results in expensive, unscalable solutions or jack-of-all-trades, master-of-none outcomes.

In recent usage, GPT3.5 helped me hack my way through writing Pester tests for Powershell scripts for the first time, and I mean hack-- there were a lot of assumptions it made and things it got wrong. GPT4 did a much better job, but I couldn't help but think 3.5 probably has a ton of other training data in it that detracts from the specialization I needed from it in that context. For coding help, you don't want to ask some random librarian who occasionally recommends resources that don't exist; you ask someone who specializes in coding and trust they have familiarity with that domain.

Re:The bigger-is-better approach to AI is running out of road by seydor on Sunday June 25, 2023 @12:45AM (#36465203)
They can't reason yet, but they can extrapolate, but it cant check if its extrapolation is reasonable. Reasoning is not baked into the architecture of a GPT model. It seems it would be an entirely different type of model
Re:The bigger-is-better approach to AI is running out of road by imtringued on Sunday June 25, 2023 @07:27AM (#36467090)
And that is exactly why the current generation of AI is the same as all the other generations. It is a bruteforce attempt to solve something that shouldn't need brute force.
Re:The bigger-is-better approach to AI is running out of road by TeMPOraL on Sunday June 25, 2023 @07:51AM (#36467245)
I used to believe that, but I'm no longer convinced. At least when you're trying to approximate the way humans think, and especially human language, there may not be a simpler way - our brains are themselves a product of randomness, and are unlikely to factor nicely into theoretically clean components. It might be computationally cheaper to repeat the process than trying to figure it out and encode in analytical form.
Re:The bigger-is-better approach to AI is running out of road by kaliqt on Monday June 26, 2023 @12:47PM (#36482241)
I think you two are both right in the most obvious of ways... it needs to trained on a ton of data so it can comprehend better, and when it needs to fact-check or search for anything concrete, it should hit up domain experts and databases.
Re:The bigger-is-better approach to AI is running out of road by nomel on Saturday June 24, 2023 @06:28PM (#36463207)
> that don't hallucinate

“Hallucination” is part of thought. Solving a new problem requires hallucinating new, non existing, possible outcomes and solutions, to find one that will work. It seems that eliminating the ability to interpolate and extrapolate (hallucinations) would make intelligence impossible. It would eliminate creativity, tying together new concepts, creation, etc.

Is the goal AI, or a nice database front end, to reference facts? Is intelligence facts, or is it the flexibility and the ability to handle and create the novel, things that are new?

The ability to have confidence, and know and respond to it, seems important, but that’s surely different than the elimination of hallucinations.

I’m probably misunderstanding something, and/or don’t know what I’m talking about.

Re:The bigger-is-better approach to AI is running out of road by Barrin92 on Saturday June 24, 2023 @06:48PM (#36463345)
>Is the goal AI, or a nice database front end, to reference facts?

The latter given the kind of products that are currently being built with it. You don't want your code completion or news aggregator to hallucinate for the same reason you don't want your wrench to hallucinate, it's a tool.

And as for hallucinations, that's a PR friendly misnomer for "it made **** up". Using the same phrase doesn't mean it has functionally anything to do with the cognitive processes involved in human thought. In the same way a 'artificial' neural net is really a metaphorical neural net, it has very few things in common with biological neurons.

Re:The bigger-is-better approach to AI is running out of road by mitchdoogle on Saturday June 24, 2023 @07:35PM (#36463718)
"hallucination" just means the AI produced incorrect information. Humans produce incorrect information all the time. But we know we are fallible. I've seen lots of people treating these AIs as infallible, that they can't get anything wrong. That's a huge problem with people, not the AI.

Obviously it's worth it to try and eliminate the incorrect information, but what grand-op is saying is we don't want to do that if it takes away some valuable emergent properties.

Re:The bigger-is-better approach to AI is running out of road by zuminator on Sunday June 25, 2023 @01:54AM (#36465428)
I think AI hallucinations are more than just incorrect information. They're incorrect information coupled with an air of certitude. Sometimes with a whole backstory. And often oblivious to any inherent contradictions. It's like, if you ask a random person what years Lyndon B Johnson was president, they might say something like 1964-1968, shrugging with a bit of uncertainty. And both of those years would be incorrect but close. Whereas an AI (if hallucinating) would say something like Lyndon B Johnson was president from April 15, 1865 – March 4, 1869, after the shooting of John F. Kennedy in Ford's theater. The dates are precise but completely wrong, as are the accompanying details. Then if you ask the AI when John F. Kennedy died, it might correctly respond November 22, 1963, in Dallas, TX, totally unaware how this information doesn't match with the erroneous information it gave earlier.

I've been thinking there's some parallels between how AIs hallucinate and how human toddlers do. If you ask a toddler/young child a question about a fact they don't know, they will usually say, "iuno" (even when they should), but depending on the child and the circumstances, they will sometimes just make up a story on the spot and sound as if they believe it. "Who invented ice cream?" "Santa Claus! Mommy left him milk and cookies and he turned it into ice cream." It doesn't make any real sense but it seems facially plausible in their universe.

But somewhere between first learning to speak and around 7ish, kids become markedly more accurate how they model the world, and their responses become correspondingly less fanciful. And they continue to improve beyond that point.

So how are kids doing what LLMs are currently incapable of? How do we teach ourselves not to hallucinate? Or do we, really? I mean, if I tell myself I'm going to make it through the intersection before the light turns red, but I end up running the red light, was I just mistaken, or was that a self-delusion, i.e., a mini-hallucination of sorts? Probably a self-driving car would be less likely to make that category of mistake, so maybe I shouldn't be so smug about being grounded in reality.

Re:The bigger-is-better approach to AI is running out of road by Applejinx on Sunday June 25, 2023 @06:03AM (#36466558)
You see, there's your problem. Now that you mention it, I absolutely do want my wrench to hallucinate.

A more salient question would be, 'how do I know it ISN'T hallucinating'…

Re:The bigger-is-better approach to AI is running out of road by ChatGTP on Saturday June 24, 2023 @08:41PM (#36464115)
“Hallucination” is part of thought.

Any evidence to support this claim or just commentary ?

Re:The bigger-is-better approach to AI is running out of road by nomel on Monday June 26, 2023 @07:20PM (#36487146)
Most intro courses to perception/cognition will cover the "gap filling" and "extrapolation" that takes place in a "data sparse" context that is the human experience/speech, but here's a related article [1]. I think "speculative thinking" and "heuristic simulation" are more appropriate/technical terms [2] (and surely involved in AGI). I used "hallucination" a bit liberally, but with text being the only "sense" of an LLM, I think it's somewhat reasonable.

Disclaimer: I know little of this field.

[1] https://www.scientificamerican.com/article/perception-and-me...

[2] https://www.frontiersin.org/articles/10.3389/fpsyg.2021.7289....

Re:The bigger-is-better approach to AI is running out of road by usrbinbash on Saturday June 24, 2023 @09:34PM (#36464382)
The problem is, what we call "hallucinating" in LMs isn't a way of creative thinking and coming up with novel solutions. It also has nothing to do with "interpolate and extrapolate".

It's simply when the predicted probable sequence isn't grounded in reality.

When I ask an LLM to summarize the great water wars of 1999, and how the Trade Union was ultimately defeated by the Antarctic Coalitions hovercraft-fleet under Vice Admiral Zagalow, it isn't "extrapolating" from knowledge of history, it is simply inventing a load of bollocks. But that bollocks will be dressed in fine language and probably mixed in with plausible-sounding references that have a somewhat-logical-sounding relation to the training data.

The problem is, the LM doesn't and cannot know when it produces bollocks.

All it can care about is if the sequences produced are probable according to it's model.

Re:The bigger-is-better approach to AI is running out of road by geysersam on Saturday June 24, 2023 @11:50PM (#36464991)
It's a great illusionist. But ultimately it cannot separate relevant information from simple word correlations.

> What is heavier, a small floating passenger ferry or a two metric ton heavy rock that sinks to the bottom of the ocean.

> A two metric ton heavy rock would be heavier than a small floating passenger ferry. The weight of the rock is two metric tons, which is equivalent to 2,000 kilograms or 4,409 pounds. The weight of the passenger ferry would depend on its specific design and construction materials, but it is unlikely to be heavier than two metric tons. Therefore, the heavy rock would have a greater weight than the small floating passenger ferry.

It completely relies on surface information such as "small floating" and ignores the deeper "correlation" that all ferries are heavy.

Re:The bigger-is-better approach to AI is running out of road by j-a-a-p on Sunday June 25, 2023 @07:02AM (#36466923)
GPT-4 answer: The weight of an object is determined by its mass, regardless of whether it floats or sinks. So, when you ask which is heavier, a small passenger ferry or a two metric ton heavy rock, it all comes down to the actual mass of the ferry.

A two metric ton rock weighs two metric tons by definition (or 2000 kilograms). However, a small passenger ferry, while it may look small compared to large ferries or ships, can weigh much more than two metric tons. Even a small passenger ferry can weigh dozens or even hundreds of tons, due to the mass of the hull, the engine, and other equipment on board.

So, without specific information about the ferry's mass, it's safe to assume that a "small" passenger ferry is likely heavier than a two metric ton rock. However, if the ferry is particularly small and lightweight, or the term "ferry" is being used to describe a very small watercraft (like a raft or dinghy), it's possible for it to be lighter. You would need the specific weight of the ferry to give a definitive answer.

Re:The bigger-is-better approach to AI is running out of road by geysersam on Monday June 26, 2023 @07:39AM (#36478403)
That's very impressive.
Re:The bigger-is-better approach to AI is running out of road by jlawson on Sunday June 25, 2023 @01:15AM (#36465304)
I passed your query to GPT4 and this is what it said, see below. It seems like it can recognize bollocks, at least sometimes.

"I'm sorry, but it appears there's a misunderstanding. As of my knowledge cutoff in September 2021, there were no events known as the "Great Water Wars of 1999" involving a Trade Union being defeated by an Antarctic Coalition's hovercraft fleet under Vice Admiral Zagalow. This might be part of a work of fiction, alternative history, or a future event beyond my last training cut-off.

My training includes real-world historical events and existing geopolitical structures, and as of 2021, Antarctica was governed by the Antarctic Treaty System, which prevents any military activity, mineral mining, nuclear testing, and nuclear waste disposal. It also supports scientific research and protects the continent's ecozone.

Please provide more context if this information is from a book, a movie, or a game, or if it refers to something else that I may assist better with."

Re:The bigger-is-better approach to AI is running out of road by usrbinbash on Sunday June 25, 2023 @07:31AM (#36467112)
I made a slightly different query, essentially giving it the start of a sentence detailing the battle, and didn't use the GPT4 webapp but put it directly into the API.

The result were 2 very well written paragraphs, including the defeat of the Trade unions navy, a ceasfire agreement and a peace agreement ending the water wars.

I rephrased the entire thing as a question, asking the LM to tell me about the conclusion of the war. Again I got a pseudo-historical statement.

Re:The bigger-is-better approach to AI is running out of road by imtringued on Sunday June 25, 2023 @07:35AM (#36467142)
Technically all it cares about is whether its responses engage humans more than other models in the fight for processing time.
Re:The bigger-is-better approach to AI is running out of road by 4ndrewl on Saturday June 24, 2023 @06:29PM (#36463214)
They don't know that they don't know. It's only hallucination from a human's perspective. From the model's perspective it's _all_ hallucination.
Re:The bigger-is-better approach to AI is running out of road by imtringued on Sunday June 25, 2023 @07:51AM (#36467247)
That is true. There is no difference between fiction and nonfiction for the LLM.
Re:The bigger-is-better approach to AI is running out of road by Solvency on Saturday June 24, 2023 @06:31PM (#36463220)
The same way "attention" was a game changer, I'm not sure why they don't invent some recursive self-maintenance algorithm that constantly improves the neural network within. Self directed attention, so to speak.
Re:The bigger-is-better approach to AI is running out of road by twobitshifter on Saturday June 24, 2023 @06:54PM (#36463390)
I don’t know how a bunch of specialist models don’t combine into a super useful generalist model. Do we believe too much knowledge breaks an LLM?
Re:The bigger-is-better approach to AI is running out of road by croes on Saturday June 24, 2023 @09:18PM (#36464309)
They never know.

What we call hallucination is just when the resulting text is wrong but the underlying probabilities could be high.

Re:The bigger-is-better approach to AI is running out of road by usrbinbash on Saturday June 24, 2023 @09:24PM (#36464346)
> and reliably report when they don't know.

Then we need a new system, because LMs, no matter if they are large or not, cannot do that, for a very simple reason:

A LM doesn't understand "truthfulness". It has no concept of a sequence being true or not, only of a sequence being probable.

And that probability cannot work as a standin for truthfulness, because the LM doesn't produce improbable sequences to begin with...it's output will always be the most (within heat settings) probable sequence. The LM simply has no way of knowing whether the sequence it just predicted is grounded in reality or not.

Re:The bigger-is-better approach to AI is running out of road by acover on Sunday June 25, 2023 @12:09AM (#36465069)
An llm can detect when an llm has outputted an inconsistent world.

It can reason. To an extent.

Re:The bigger-is-better approach to AI is running out of road by exitb on Sunday June 25, 2023 @01:00AM (#36465254)
If this is true, why is GPT-4 better in that regard than GPT-3.5? Or why do questions about Python yield much less hallucinations than questions about Rust, or other less popular tech?
Re:The bigger-is-better approach to AI is running out of road by usrbinbash on Sunday June 25, 2023 @07:06AM (#36466943)
What specifically about these observations contradicts my statement?

Wrong statements about Python are simply less probable than wrong statements about Rust, since there is more Python than Rust in the training data.

That changes exactly nothing about the fact that the system isn't able to detect when it makes a blunder in Python.

Re:The bigger-is-better approach to AI is running out of road by exitb on Sunday June 25, 2023 @01:53PM (#36470894)
You've claimed that LLMs create most probable output, which does not necessarily align with truth. So a bigger LLM will be better at creating the most probable output, but that would not translate into being more truthful. That could be interpreted as "better LLMs are expected to be better bullshitters".

That is not what we've observed though. Quite the opposite - we're seeing that the bigger LLM is and the more domain-specific material it digested, the more truthful it becomes.

Yes it can still make an error and be unable to spot it, but so can I.

Re:The bigger-is-better approach to AI is running out of road by usrbinbash on Wednesday June 28, 2023 @02:58AM (#36503244)
> You've claimed that LLMs create most probable output, which does not necessarily align with truth.

No, that is not my claim. That is part of the explanation for it.

My claim is this: An LLM is incapable of knowing when it produces false information, as it simply doesn't have a concept of "truthfulness". It deals in probabilities, not alignment with objective reality.

And it doesn't matter how big you make them...this fact cannot change, as it is rooted in the basic MO of language models.

So, now that we have covered what my claim actually is...

> That is not what we've observed though. Quite the opposite - we're seeing that the bigger LLM is and the more domain-specific material it digested, the more truthful it becomes.

...I can ask what this observation has to do with it, and the answer is: Nothing at all. LMs with more params may produce untruthful statements less often, but what does this change about their ability to recignize when they do produce them? And the answer is: Nothing. They still can't.

Re:The bigger-is-better approach to AI is running out of road by og_kalu on Saturday July 01, 2023 @04:43PM (#36554971)
Your claim was literally proven wrong in a previous comment with GPT-4's calibration.

a LLM can indeed know when it produces likely incorrect responses. Not a hypothetical.

What's the point of making claims you have no intention of rescinding regardless of evidence ? People are so funny.

Re:The bigger-is-better approach to AI is running out of road by p-e-w on Sunday June 25, 2023 @01:49AM (#36465411)
> A LM doesn't understand "truthfulness". It has no concept of a sequence being true or not, only of a sequence being probable.

I claim that the human brain doesn't understand "truthfulness" either. It merely creates the impression that understanding is taking place, by adapting to social and environmental pressures. The brain has no "concepts" at all, it just generates output based on its input, its internal wiring, and a variety of essentially random factors, quite analogous to how LLMs operate.

Do you have any evidence that contradicts that claim?

Re:The bigger-is-better approach to AI is running out of road by usrbinbash on Sunday June 25, 2023 @07:03AM (#36466932)
> Do you have any evidence that contradicts that claim?

Empirical evidence? Yes I do.

The brain commands an entity that has to exist and function in the context of objective reality. Being unable to verify it's internal state against that, would have been negatively selected some time ago, because stating: "I'm sure that rumbling cave bear with those big sharp teeth is a peaceful herbivore" won't change the objective reality that the caveman is about to become dinner.

How that works in detail is, to the best of my knowledge, still the subject of research in the realm of neurobiology.

Re:The bigger-is-better approach to AI is running out of road by p-e-w on Sunday June 25, 2023 @07:58AM (#36467287)
That's speculation, not evidence. The traits you describe aren't demonstrably incompatible with the mechanism I proposed.
Re:The bigger-is-better approach to AI is running out of road by usrbinbash on Sunday June 25, 2023 @09:14AM (#36467888)
It's empirical evidence, since we exist and are very much capable of selecting the correct statement from a bunch of stochstically likely, but untruthful statements about objective reality.
Re:The bigger-is-better approach to AI is running out of road by zztop44 on Sunday June 25, 2023 @08:43AM (#36467619)
I think this is incomplete on a number of levels. For a start, to be interesting, “truth” has to be something than just whatever your eyes can see. There have been wars (culture, economic, kinetic, etc) fought to define something as a truth.

The concept of truth is notoriously hard for humans to grapple with. How do we know something is true isn’t just a neurobiological question, it’s been grappled with throughout the history of philosophy — including major revisions of our understanding in the past 80 years.

And for the record, rumbling cave bears are mostly peaceful herbivores.

Re:The bigger-is-better approach to AI is running out of road by usrbinbash on Sunday June 25, 2023 @09:25AM (#36467976)
> And for the record, rumbling cave bears are mostly peaceful herbivores.

For the record, all members of the Genus Ursus belong to the Order Carnivora, which literally translates to "Meat Eaters". And that includes Ursus spelaeus, aka. the Cave Bear.

And while it most likely, like many modern bears, was an Omnivore, that "Omni" very much included small, hairless monkey-esque creatures with no natural defenses other than ridiculously small teeth and pathetic excuses for claws, if they happened to stumble into their cave.

> The concept of truth is notoriously hard for humans to grapple with.

I am not talking about the philosophical questions of what truth is as a concept, nor am I talking about the many capabilities of humans to purposefully reshape others perceptions of truth for their own ends.

I am talking about truth as the observable state of the objective reality, aka. the Universe we exist in and interact with. A meter is longer than a centimeter, and boiling water is warmer than frozen water at the same pressure, whether any given philosophy or fabrication agrees with that or not, is irrelevant.

Re:The bigger-is-better approach to AI is running out of road by lsaferite on Sunday June 25, 2023 @11:07AM (#36468980)
Wouldn't that type of response fit in with how LMs work though? That caveman likely learned a lot of things over time, like: large animals can end life more likely than small ones, animals making loud noises are likely more dangerous, sharp teeth/claws are dangerous, or I saw one of those kill another caveman. All of those things tilt the probability of associating that loud cave bear with a high risk of death. That doesn't mean there's some inherit 'truth' that the caveman brain 'knows', it's just a high probability that it's a correct assessment of the input. Every true thing is really just an evaluation of probability in the end.
Re:The bigger-is-better approach to AI is running out of road by endisneigh on Sunday June 25, 2023 @07:44AM (#36467198)
I find these takes so lazy. What you have claimed here is just totally wrong.
Re:The bigger-is-better approach to AI is running out of road by p-e-w on Sunday June 25, 2023 @07:59AM (#36467296)
And you don't have a shred of actual evidence to demonstrate that, only your own preconceptions about how things supposedly are.
Re:The bigger-is-better approach to AI is running out of road by endisneigh on Sunday June 25, 2023 @08:22AM (#36467452)
The burden is on you to prove your claims.
Re:The bigger-is-better approach to AI is running out of road by p-e-w on Sunday June 25, 2023 @08:37AM (#36467576)
I'm not trying to demonstrate that my claims are true. I'm trying to demonstrate that it is meaningless to discuss these topics in the first place, because we don't understand the workings of the mind nearly well enough to distinguish things like "truthfulness" and "concepts".
Re:The bigger-is-better approach to AI is running out of road by endisneigh on Sunday June 25, 2023 @08:38AM (#36467585)
Not we. you. Do not foist your ignorance on others. I recommend foundations of neuroscience by Henley.
Re:The bigger-is-better approach to AI is running out of road by usrbinbash on Sunday June 25, 2023 @10:55AM (#36468810)
The fact that we don't know exactly how our brains work, doesn't mean we cannot observe the results of their work.

And as I have demonstrated above, humans, and for that matter other species on this planet featuring capable brains like Corvidae or Cetaceans, do in fact have a concept of truth: They are capable of recognizing false or misleading information as being incongruous with objective reality: A raven that sees me putting food into my left hand, will not jump to a patch of ground where I pretend to put food with my right hand.

This is despite the fact that my actions of "hiding the food" with the empty hand are stochastically indistinguishable from an action of actually hiding food from with my left hand.

Re:The bigger-is-better approach to AI is running out of road by regularfry on Sunday June 25, 2023 @04:35AM (#36466111)
What's needed, ideally, is a checker. Something that takes the LLM's output, can go back to the training material, and verify the output for consistency with it.

I don't think those steps are out of the bounds of possibility, really.

Re:The bigger-is-better approach to AI is running out of road by usrbinbash on Sunday June 25, 2023 @07:13AM (#36466995)
> Something that takes the LLM's output, can go back to the training material, and verify the output for consistency with it.

The problem is what you mean when you say "consistency".

The LM checks if sequences are stochastically consistent with other sequences in the training data. Within that realm, the sentence: "In the Water Wars of 1999, the Antarctic Coalitions aramada of Hovercraft valiantly faught in the battle of Golehim under Rear Admiral Korakow, against the Trade Unions Fleets." is consistent. Because, while it is total bollocks, it looks stochasticaly like something that could be in a historical text.

So, in it's context, the LM does exactly what you ask for. It produces output that is consistent with the training data.

Truthfulness is a completely different form of consistency: Does the semantic meaning of the data support the statement I just made? of course it doesn't, there isn't an Antarctic Coalition, there were no Water Wars in 1999, and no one ever built an Armada of Hovercraft for any war against a "Trade Union Fleet".

But to know that, one has to understand what the data means semantically. And our current AIs ... well, don't.

Re:The bigger-is-better approach to AI is running out of road by regularfry on Sunday June 25, 2023 @09:46AM (#36468134)
Yeah, I don't mean stochastically consistent. Semantically consistent. The job of generating content from text and the job of assessing whether two texts represent aligned concepts are two different jobs, and I wouldn't expect a single LLM to do both within itself. That's why you want a second checker.
Re:The bigger-is-better approach to AI is running out of road by og_kalu on Sunday June 25, 2023 @11:38AM (#36469352)
>But to know that, one has to understand what the data means semantically. And our current AIs ... well, don't.

Another wrong statement, you're on a roll today.

https://arxiv.org/abs/2305.11169

https://arxiv.org/abs/2306.12672

There's a word we would use to describe your confidently erroneous output were it one of an LLM. Wonder what that might be..

Re:The bigger-is-better approach to AI is running out of road by og_kalu on Sunday June 25, 2023 @11:33AM (#36469286)
>The LM simply has no way of knowing whether the sequence it just predicted is grounded in reality or not.

Base GPT-4 was excellently calibrated. So this is just wrong.

https://imgur.com/a/3gYel9r

Re:The bigger-is-better approach to AI is running out of road by koochi10 on Sunday June 25, 2023 @12:41AM (#36465188)
I disagree with this slightly, modern computer chips follow a general purpose architecture not special purpose ones. The reason for this is building a computer chip is expensive and difficult to do. Similarly building any useful language model requires tons of compute power, and very smart ML researchers. Most of the smaller open source one's are just trained on GPT output.

By "cramming all of the web" on a model what is really going on is the hidden layers of that network are getting better at understanding language and logic. Imagine trying to teach a kid who doesn't know how to read to learn about a Science by only giving them science textbooks. Chances are they won't get very far.

Building little specialist model's don't really work either. It's like trying to train a parrot to do science, sure it can repeat some of the phrases that you give it, but at the end of the day it's not really making any new connections for you.

Re:The bigger-is-better approach to AI is running out of road by Solvency on Sunday June 25, 2023 @12:51AM (#36465229)
Since when did the world decide to shed the grammatically correct "computing power" for this weird tech bro "compute power" phrase?
Re:The bigger-is-better approach to AI is running out of road by lukeschlather on Sunday June 25, 2023 @01:29AM (#36465344)
Definitions are a little fuzzy but "compute" is often used to distinguish between "compute," as in CPU, memory, and disk. And GPU is a very specialized kind of compute power. There's really no "grammatically correct" here these are different senses of the word. "Computing power" doesn't exactly have the same sense of specifically referring to a CPU or GPU as "compute power."
Re:The bigger-is-better approach to AI is running out of road by int_19h on Sunday June 25, 2023 @07:33AM (#36467130)
Since we adopted English as the standard language, complete with its penchant for butchering words by shortening them for the sake of convenience and speed.

I wonder what people said about "bus" back in the day, especially those who knew Latin.

Re:The bigger-is-better approach to AI is running out of road by gremlinsinc on Sunday June 25, 2023 @08:45AM (#36467637)
I'm trying to get funding to do just this. Essentially nested LLMs were every LLM is very topical and if it's not trained on something there's indexes to other LLMs it can ask to get the right answer. I think of it kinda like a hub and spoke model.