News for hackers. Stuff that matters.
Re:Markov chains are funnier than LLMs by fishtoaster on Monday August 19, 2024 @12:24AM (#41287805)
I came to this same conclusion some years ago while working on a side project.

Before anything LLM existed, I built a site[0] to generate fake "AWS Blog Posts." I trained a markov chain generator on all AWS announcement posts up to that point, copied the html + css of aws's standard blog posts, then glued them all together with some python + JS. It turned out, IMO, pretty funny! People familiar with AWS's blog posts would often get several sentences in before they realized they were looking at word-soup.

When GPT was new, I looked into using that to "upgrade" it. I spent a weekend messing around with Minimaxir's gpt-2-simple generating blog posts based on AWS content. What I found was, ultimately, it was way less fun. The posts were far too realistic to be interesting. They read like totally-real blog posts that just happened to not be true.

I realized then that the humor of those early markov generations was the ridiculousness. The point where, a few words or sentences in, you realized it was all nonsense. LLM's these days are too good for that - the text they generate is sometimes wrong, but rarely nonsense in a humorous way.

Markov chain content was wrong in a "kid's say the darndest things" way, while modern LLMs are wrong in a "My uncle doesn't know basic geography" way.

[0] https://totes-not-amazon.com/ - click any link to get a new one.

Re:Markov chains are funnier than LLMs by mdp2021 on Monday August 19, 2024 @04:13AM (#41288941)
> modern LLMs are wrong in a "My uncle doesn't know basic geography" way

Oh, certainly not. I have been using LLM chatbots extensively this week. If your uncle were not just confident while stating falsities, but uncapable of self-assessment, he would have been murdered.

Re:Markov chains are funnier than LLMs by TeMPOraL on Monday August 19, 2024 @04:22AM (#41289009)
Or made a stellar career as a salesman or politician.
Re:Markov chains are funnier than LLMs by mdp2021 on Monday August 19, 2024 @04:29AM (#41289045)
Until you are caught (in good societies).
Re:Markov chains are funnier than LLMs by TeMPOraL on Monday August 19, 2024 @04:33AM (#41289064)
Or fresh ones. Established democracies end up with political structures that self-select for being able to sound right and cooperate right, entirely independent of truth and merit.
Re:Markov chains are funnier than LLMs by mdp2021 on Monday August 19, 2024 @05:00AM (#41289217)
I coincidentally just stumbled on a recent implicit comment by Angél Boligan Corbo:

Title: "The Talker" - https://image.cagle.com/287573/980/-the-talker.png

Re:Markov chains are funnier than LLMs by sitkack on Tuesday August 20, 2024 @01:36PM (#41302101)
That sounds like all bureaucracies.
Re:Markov chains are funnier than LLMs by Kiro on Monday August 19, 2024 @04:54AM (#41289187)
> I have been using LLM chatbots extensively this week.

This reads as "I've actually used LLMs" like it's a rare occurrence giving you a unique insight, when most of us have been using LLMs extensively for almost two years now.

Re:Markov chains are funnier than LLMs by mdp2021 on Monday August 19, 2024 @04:58AM (#41289205)
> This reads

Oh please. Guidelines: «respond to the strongest plausible interpretation».

Does the form "An occasion of extensive use of the main current chatbots for circumstantial reasons in the past few days confirmed and reinforced the assessments raised years ago already" work better for you?

Re:Markov chains are funnier than LLMs by wizzwizz4 on Monday August 19, 2024 @05:17AM (#41289306)
I think most of us haven't, but those who do are vocal about it. (Those who haven't aren't all that vocal, excluding weirdos like me.) Only 62% of respondents to the 2024 Stack Overflow Developer Survey are “currently [using] AI tools in [their] development process” (up from 44% last year), and non-programmers seem to use them far less.
Re:Markov chains are funnier than LLMs by fouronnes3 on Monday August 19, 2024 @01:43AM (#41288128)
Reminds me of git man pages generators. Extremely fun as well when you can't quite tell if it's real.
Re:Markov chains are funnier than LLMs by majewsky on Tuesday August 20, 2024 @09:58AM (#41300137)
Re:Markov chains are funnier than LLMs by kqr on Monday August 19, 2024 @05:19AM (#41289322)
(a) That site is very funny. Thanks for sharing!

(b) The kids-vs-uncle metaphor is spot on in my experience too, and also illustrates how far these language models have come.

Re:Markov chains are funnier than LLMs by daemin on Monday August 19, 2024 @05:35AM (#41289397)
I think the "uncle that doesn't know anything but claims to be an expert and will tell you his opinion" is the best description of LLMs that I can think of. They will say anything confidently without knowing anything.
Re:Markov chains are funnier than LLMs by boredemployee on Monday August 19, 2024 @08:04AM (#41290282)
>> They will say anything confidently without knowing anything.

Understanding how these algorithms work, I don't know why we would expect anything different from this?

Re:Markov chains are funnier than LLMs by boesboes on Monday August 19, 2024 @08:47AM (#41290582)
Most ppl don't understand shit about these algorithms and will expect it be truthful and knowledgable. That is how it's marketed, despite the disclaimers..
Re:Markov chains are funnier than LLMs by K0balt on Monday August 19, 2024 @09:13AM (#41290773)
It should be marketed more like “uncle Jim” than a trustworthy, all-domain competent oracle. I think if you just gave it a twangy accent and changed some output nouns to thingy, whatchamacallit and doohickey, people would actually be able to use it more competently.
Re:Markov chains are funnier than LLMs by lordnacho on Monday August 19, 2024 @09:02AM (#41290690)
Because it's marketed as AI.

For me, my expectations are adjusted. I kinda know what to expect it to do, and it does quite well for what I use it for, essentially smart intellisense for coding.

Re:Markov chains are funnier than LLMs by beeboobaa3 on Monday August 19, 2024 @11:28AM (#41291858)
I would have expected the people who trained these systems to not format their Q/A samples to sound authoritatively while they knew the system was going to be spouting nonsense.
Re:Markov chains are funnier than LLMs by jononor on Monday August 19, 2024 @04:07PM (#41294185)
The sheer amount of companies, media, influencers, heck even government agencies, acting otherwise? With billions of dollars on the line, there are many powerful forces pushing for people to have unrealistic expectations about LLMs (or "AI" as they call it).

A lot of money is being spent on trying to improve it too. But right now the emperor has very little clothes. It remains to be seen whether they have materialized by the time people open their eyes.

Re:Markov chains are funnier than LLMs by HeatrayEnjoyer on Monday August 19, 2024 @05:38AM (#41289416)
Perfectly humanlike
Re:Markov chains are funnier than LLMs by HPsquared on Monday August 19, 2024 @07:42AM (#41290158)
Indeed, the more I use LLMs and see the confabulated output, I've started seeing similar in how actual people talk.
Re:Markov chains are funnier than LLMs by hoseja on Monday August 19, 2024 @05:53AM (#41289489)
We gave up the pursuit of pure crystalline Intelligence and instead just remade ourselves. Hopefully the AIs will be able to do better.
Re:Markov chains are funnier than LLMs by Bluestein on Monday August 19, 2024 @07:16AM (#41289971)
Yeah. We don't need Artificial Intelligence. We need to discover Actual Intelligence :)
Re:Markov chains are funnier than LLMs by pbronez on Monday August 19, 2024 @07:53AM (#41290217)
My favorite is “mansplaining as a service”
Re:Markov chains are funnier than LLMs by joloooo on Monday August 19, 2024 @10:59AM (#41291624)
LLMs are really disrupting the market for Mckinsey junior analysts meeting with clients.
Re:Markov chains are funnier than LLMs by mapt on Monday August 19, 2024 @11:03AM (#41291659)
Can an LLM provide the sort of psychological buffer that McKinsey Junior Analysts (some random person picked up off the street in a college town and handed a clipboard, a frequent flier card, and a six figure salary) provide to senior managers against the scrutiny of their board and chief executive?

If I want to close the paper division, and my boss wants to close the paper division, does the LLM whisper sweet nothings in our ear and show soothing Powerpoint decks about how in the eyes of an objective observer, the paper division is unprofitable and there would be no career risk in closing it?

It's not a sexual thing I swear, it's a sort of comforting intimacy that needs to be injected into the business process in order to cope with the pressures executives feel. I don't know that anybody has trained an LLM to do that yet.

Re:Markov chains are funnier than LLMs by joloooo on Monday August 19, 2024 @05:00PM (#41294549)
I think this is the next sequel to the movie "Her".

You bring up a good point though. Very dystopian idea of a new type of enterprise tooling that emerges to soothe and calibrate human knowledge workers. Very Severance Wellness room.

Re:Markov chains are funnier than LLMs by DeadlockISDota3 on Monday August 19, 2024 @05:55AM (#41289504)
I figured this same thing in a similar manner. I used to make markov chains of game patches and send them to the community. Fake dota patches were a huge hit, specially since those are usually huge. Among mostly non-sense or unfunny exaggeration ("this hero now has 500 armor"), there would usually be at least 5 or 6 extremely funny lines in there, if not stuff that was outright prophetic (Fiend's Grip creates additional 1/2/3 illusions).

LLM's did a number on that unfortunately. Major subreddits banned all AI content, mostly due to the sheer infestation of really boring Midjourney content sent out by naive users and bots. Without reach, I lost interest, so no more Markov Chains.

Re:Markov chains are funnier than LLMs by unshavedyak on Monday August 19, 2024 @01:47PM (#41293056)
Hah, i felt compelled to mention Deadlock because of your Dota comments. Then i noticed your name.
Re:Markov chains are funnier than LLMs by erk__ on Monday August 19, 2024 @02:39PM (#41293567)
I am sure I even remember that Valve once incorporated something from one of the fake patch notes in one of their patches, but now I cannot find it. It was something like +1 damage to something that already did a lot of damage.
Re:Markov chains are funnier than LLMs by tyjo99 on Tuesday August 20, 2024 @01:45PM (#41302178)
Probably the Techies +25x damage talent? In 2017 [7.07] it was increased from +250 damage to +251 damage. Then in 2020 [7.28] it was increased again to +252 damage.
Re:Markov chains are funnier than LLMs by erk__ on Tuesday August 20, 2024 @02:05PM (#41302394)
After some more looking around I found it, Puck's orb gained 1 movement speed in 6.87 [0] after the markov chain notes for the patch [1]. Though I think the techies one is a similar joke.

[0]: https://www.dota2.com/687

[1]: https://old.reddit.com/r/DotA2/comments/4fw6gm/how_687_would...

Re:Markov chains are funnier than LLMs by nom on Monday August 19, 2024 @08:31AM (#41290476)
First thing I read on that page:

> There is no charge associated with your streamed applications, simply click Enable Microphone from the ElastiCache documentation.

It's way funnier when our brains try to make sense of the nonsense.

Re:Markov chains are funnier than LLMs by maicro on Monday August 19, 2024 @09:13AM (#41290770)
I played around with a Markov generator many years ago, trained on the corpus of everything I had ever said in a specific IRC channel. The resulting messages were pretty interesting - I specifically remember the realization that I apparently (used to, though honestly still do, too) talk about LEDs a lot...
Re:Markov chains are funnier than LLMs by passion__desire on Monday August 19, 2024 @11:11AM (#41291716)
https://cemulate.github.io/the-mlab/#y3Bt-co-extensional+lim...

https://github.com/cemulate/the-mlab

This is a parody of the nLab, a wiki for collaborative work on category theory and higher category theory. As anyone who's visited is probably aware, the jargon can be absolutely impenetrable for the uninitiated -- thus, the idea for this project was born!

This project uses my package nearley-generator, a module that can turn a Nearley grammar into an efficient and controllable fake text generator. The grammar file for this site can be found at /src/grammar/nlab.ne

Re:Markov chains are funnier than LLMs by xnx on Monday August 19, 2024 @11:20AM (#41291804)
> What I found was, ultimately, it was way less fun

I wonder if there is combination of temperature and prompt engineering that could make it interesting.

Re:Markov chains are funnier than LLMs by shawabawa3 on Monday August 19, 2024 @05:06PM (#41294594)
I just asked chatgpt to create an Aws product announcement in the style of Markov generated text and it was pretty good
Re:Markov chains are funnier than LLMs by m3047 on Monday August 19, 2024 @12:32PM (#41292464)
I did the same thing and used it as the chum for a 'bot motel. (A 404 handler that always returns something and... success!). I trained it on a mixed NASA space shuttle and veterinary science corpus just to make it really bizarre.
Re:Markov chains are funnier than LLMs by to11mtm on Monday August 19, 2024 @06:44PM (#41295186)
> I realized then that the humor of those early markov generations was the ridiculousness. The point where, a few words or sentences in, you realized it was all nonsense. LLM's these days are too good for that - the text they generate is sometimes wrong, but rarely nonsense in a humorous way.

This is the biggest challenge I run into when I see LLM Generated nonsense.

So much stuff that ChatGPT spits out is close enough to true that Brandolini is laughing.

But it's also that it's borrowing on stuff that's already there so it can't really get that 'creative' either.