News for hackers. Stuff that matters.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by superultra on Tuesday November 21, 2023 @11:38PM (#38374782)
I’ve been using this for several weeks now and it’s replaced podcasts for me. I’ll just pick a topic and then ask for a summary and then ask clarifying questions. Other times I’ll just goof off. In one chat, I’m rewriting the Star Wars sequels movie by movie with ChatGPT. I’ve realized that I’m built to learn socially, and ChatGPT never tires of my questions or gets annoyed.

One interesting story. My 15 year old kid was talking to it about Percy Jackson, and as Gen Z is prone to do, was using the phrase “kind of” quite a bit. At some point in the conversation, ChatGPT started using “kind of” as well in the audio. I imagine the underlying prompt is “make sure your answers are clear to the user” and somehow it’s determining that “kind of” is a way to build clarity in that context, or the phrase is informing the token set. Unsure but it was a little unsettling.

For my part I find the natural pauses and accentuations really helpful. It’ll slow down when it’s hitting an “important” or complicated bit of information, and just like with humans, the pause and change in tone are indicators.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by w-ll on Tuesday November 21, 2023 @11:52PM (#38374868)
Me, as a meat popsicle, can you explain to me how the phrase “kind of” is not common?

I feel like “kind of” is kind of a common adjective phrase, right?

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by superultra on Wednesday November 22, 2023 @12:00AM (#38374914)
It is, kind of! I definitely use it frequently, but the quantity that my kids use it is at a whole other level. But it’s a colloquial phrase that I rarely, if ever, hear ChatGPT use in the audio presentation, but looking at the chat transcript, there’s definitely a point at which it begins to use “kind of” in multiple ways in its responses, and it wasn’t before.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by sprobertson on Wednesday November 22, 2023 @02:56AM (#38376291)
A more blatant example: it will start responding in French if you start speaking to it in French. These things are pattern machines and it makes sense that it will pick up on the lingo they fed (just like we will)
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by WendyTheWillow on Wednesday November 22, 2023 @02:21AM (#38376004)
You can entirely remove it from your speech and lose very little.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by gettodachoppa on Wednesday November 22, 2023 @04:01AM (#38376811)
fr fr, low-key this is true.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by hrnnnnnn on Wednesday November 22, 2023 @04:50AM (#38377161)
This is true in the narrow sense of it not changing the literal meaning of the sentence much. In a broader sense, using "kind of" a lot is part of a sociolect (in this caze zoomers) and you would lose some sense of beloning to that group by dropping it from your speech.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by RugnirViking on Wednesday November 22, 2023 @05:58AM (#38377629)
I disagree. These linguistic innovations (including "like") serve to soften the message. It signals to the listener that the information is not based on considered truth, but on impressions, vibes. This is genuinely how its used, to signal the difference between a personal opinion and something somebody is convinced of. It's kind of like adding "but I could be wrong" to the end of everything
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by cmpalmer52 on Wednesday November 22, 2023 @10:05AM (#38380205)
I was playing with the voice interface and pointed out something minor it got wrong (a misunderstood word in my input, not a hallucination/confabulation). The voice response began with, “Oops, my bad”, which made me laugh.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by vore on Wednesday November 22, 2023 @02:13AM (#38375922)
How can you tell if ChatGPT is lying to you and what you're learning is total hogwash?
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by willvarfar on Wednesday November 22, 2023 @04:03AM (#38376831)
Right now, chatgpt is trained on a broad spectrum of slightly dated information, so hopefully the biases even out. And we know it hallucinates etc.

In the future I see two big risks with the tech, approach and ownership:

1) short term, SEO is going to move into trying to influence the LLMs to push products unwittingly. Companies will be getting great offers from shady SEO outfits promising to make their products the default answers for broad questions?

2) mid term, now that all sense and pretence of safety and greater good are gone from openai, openai will be working out how to insert and see ads in the results? There will probably even be product placement in the results coming from the paid-for in-ms-office version.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by ddxv on Wednesday November 22, 2023 @03:53AM (#38376751)
I've been developing understanding from using it for coding. I guess a lot of us are developing this understanding. It is very trustable about high level things many people know. As the knowledge is more specific or esoteric the less trustworthy it is.

If my mom asks it questions about my work industry, they are vague and high level enough that chatgpt is very accurate in it's answers.

If I ask it probing questions I care about my industry it hallucinates or fails to grasp key terminology.

So, if I was OP, likely asking it broad questions about things I know very little about is quite safe. Going too far down a rabbit hole to something super specific I would want to verify on Wikipedia.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by WendyTheWillow on Wednesday November 22, 2023 @02:20AM (#38375997)
I imagine the stakes of rewriting the Star Wars films are sufficiently low that this risk is acceptable...
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by vore on Wednesday November 22, 2023 @02:34AM (#38376115)

   I’ll just pick a topic and then ask for a summary and then ask clarifying questions.
Probably don't want to start quoting hallucinated facts!
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by WendyTheWillow on Wednesday November 22, 2023 @02:36AM (#38376130)
Good thing podcasts never have false/misleading information on them...
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by vore on Wednesday November 22, 2023 @02:38AM (#38376148)
This is an absurd argument that you are just making for the sake of argument and you know it. There's a difference between someone getting things wrong and a LLM shamelessly making something up out of the whole cloth.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by WendyTheWillow on Wednesday November 22, 2023 @02:44AM (#38376190)
No; I'm much more confident in ChatGPT's accuracy than I am in a random podcast's accuracy.

Podcasts tend to be relatively terrible, accuracy wise. If the alternative is learning from ChatGPT, your odds of getting correct information is substantially higher.

Podcasts are entertaining! But not where I would go to learn anything.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by Martinussen on Wednesday November 22, 2023 @03:39AM (#38376641)
Listen to better podcasts. :P
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by WendyTheWillow on Wednesday November 22, 2023 @03:49AM (#38376718)
It's a mistake to listen to a podcast to learn important information.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by 4ggr0 on Wednesday November 22, 2023 @04:44AM (#38377127)
That's just like, your opinion, man.

There are podcasts for almost every topic where experts are present. Journalists, Scientists, Activists, Researchers etc. can be heard in podcasts, I don't really see why it's generally a mistake to listen to a podcast to learn important information.

During the pandemic my partner was attending university from home and listening to their professors via MS Teams, these classes were also recorded so that they could listen to them at a later point. In some ways that's just a professional podcast.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by WendyTheWillow on Wednesday November 22, 2023 @05:07AM (#38377272)
I think you know that isn’t a podcast in the sense that we’re discussing.

And depending on the class and the institution, I may still trust ChatGPT more than what gets taught.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by 4ggr0 on Wednesday November 22, 2023 @05:42AM (#38377508)
Of course the part about university classes is different, but you seem to ignore everything else I've said.

There are tons of podcasts involving experts talking about their field of expertise, how can it be a mistake to listen to such podcasts to gather information?

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by WendyTheWillow on Wednesday November 22, 2023 @05:48AM (#38377555)
It’s a mistake because what drives podcasts are their popularity, not their accuracy.

There is no “sort by accuracy” button in any podcasting app, nor are they peer reviewed.

Furthermore, podcasts are not a review of the body of knowledge on a subject; they’re often a complete layperson interviewing a single member of a given field, at best. Almost never do the views of any individual actually represent any field as a whole.

So once we’ve thrown out the concept of accuracy and completeness, ChatGPT fares exceedingly well in comparison. You’d do much worse than ChatGPT for idle conversation level accuracy.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by Martinussen on Wednesday November 22, 2023 @06:04AM (#38377663)
What you just wrote makes more sense applied to LLM output than podcasts! You'd just as easily argue that "radio" or "news" is all bad if you don't want to differentiate between different forms of expression and communication within a medium. (Which, obviously, would be silly)
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by WendyTheWillow on Wednesday November 22, 2023 @06:13AM (#38377717)
Sorry what? Nothing I wrote apples to LLMs; they are not optimized for popularity, they’ve been meticulously designed and built to be as accurate as possible.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by thfuran on Wednesday November 22, 2023 @09:08AM (#38379328)
They absolutely have not been meticulously designed to be as factually accurate as possible.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by WendyTheWillow on Wednesday November 22, 2023 @01:06PM (#38382745)
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by thfuran on Thursday November 23, 2023 @08:39AM (#38392603)
That link doesn't say anything about the fundamental design goals of the network architecture or training process. It doesn't even mention factual correctness, except in the sense that it may broadly fall under "producing a desired output".
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by croon on Wednesday November 22, 2023 @03:13PM (#38384495)
No they're not. If they were, they would default to 0 temperature and have no Top P, frequency/presence penalty, and frankly not have knowledge as a function of language to begin with. They're designed to be convincing as a "presence" and output reasonable sounding language in context, with accuracy as an afterthought.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by CaptWillard on Wednesday November 22, 2023 @08:41AM (#38378970)
>Almost never do the views of any individual actually represent any field as a whole.

Setting aside the many individuals who currently lead their fields, history is filled with groundbreaking heretics.

https://informationisbeautiful.net/visualizations/mavericks-...

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by WendyTheWillow on Wednesday November 22, 2023 @01:08PM (#38382769)
History is filled with many more plain ol’ heretics however, and we’re exceptionally bad at telling the difference in the meantime.

You, most importantly, are complete garbage at telling the difference between a crackpot and an innovator in a field you know nothing about.

Trying to drink unpasteurized knowledge will infect you a lot more quickly than it will enlighten you.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by CaptWillard on Wednesday November 22, 2023 @04:07PM (#38385113)
I'd say that I regret engaging with you, but that last line is golden.

It's not censorship, propaganda and official disinformation, it's "Pasteurized Knowledge®"

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by WendyTheWillow on Wednesday November 22, 2023 @06:38PM (#38386809)
But that's the problem; you falsely believe you're capable of differentiating between propaganda and quality. You're not, on topics of which you are not an expert.

That's what flat-eartherism is, that's what jewish space lasers are. The argument you're giving is a tacit endorsement of that kind of "inquiry", which for reasonable people is unconscionable.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by apwell23 on Wednesday November 22, 2023 @11:20AM (#38381250)
This is such a weird take. Ppl don't listen to podcast like wikipedia page to learn 'facts' . Why are ppl even comparing chatgpt to podcasts.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by numpad0 on Wednesday November 22, 2023 @06:10AM (#38377710)
Problem with ChatGPT isn't that they get facts wrong, but that they're what the categorical name suggests, large language models.

At one point I came across this series of "are CJK languages related" questions in Quora with cached ChatGPT responses[1], all grammatically correct and very natural, largely turboencabulators, sometimes contradicting even within a single response.

Podcasters? They're not _this_ inconsistent.

1: https://imgur.com/a/7tlNDll

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by Last5Digits on Wednesday November 22, 2023 @08:14AM (#38378705)
Be aware that you're talking about Quora's implementation of ChatGPT here. As far as I know, the cached answers were generated with an incredibly outdated version, which is definitely not indicative of its current quality.

Even worse, I think they actually prime it with answers already posted on the thread, or even just related threads. For example, one of the answers to the first question mentions the same Altaic root as ChatGPTs answer, and I've found multiple people that are seeing their own rephrased answers in the response.

If you preprompt ChatGPT with questionable data, then the answer quality will be massively degraded. I've noticed many times now that Bing will rephrase incorrect information or construct a very shallow summary out of unrelated articles when internet searches are allowed, but is able to generate a cohesive and detailed summary when they're disabled.

Throwing random answers - some contradicting each other and some talking about subtly different aspects of the topic - into a session without further guidance just isn't a great idea.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by kaszanka on Wednesday November 22, 2023 @04:03PM (#38385060)
What's the issue with the answer for "Are Korean and Chinese mutually intelligible"? The highlighted part is definitely true, at least.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by numpad0 on Wednesday November 22, 2023 @11:23PM (#38389243)
That part is correct, but not consistent with others.

My problem is not that GPTs are too often wrong, it's that they always prioritize syntax over facts since they are _language_ models.

The sentence "Colorless green ideas" always make more sense to LLM than "Water is wet", simply because the latter is syntactically invalid, and that would be problematic for many use cases including Podcast replacement. Sometimes us humans want AI to say "water is definitively wet", and that has been attempted by forcing LLM to accept that factoids are more syntactically correct, but that isn't a solution and it's still an architectural problem for these pseudo-AGI apps.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by codethief on Wednesday November 22, 2023 @08:38AM (#38378943)
Slightly off-topic/meta but this debate reminds me of one people had 20 years ago: Should you trust stuff you read on Wikipedia or not?

In the beginning people were skeptical but over time, as Wikipedia matured, the answer has become (I think): Don't blindly trust what you read on Wikipedia but in most cases it's sufficiently accurate as a starting point for further investigation. In fact, I would argue people do trust Wikipedia to a rather high degree these days, sometimes without questioning. Or at least I know I do, whether I want to or not, because I'm so used to Wikipedia being correct.

I'm wondering what this means for the future of LLMs: Will we also start trusting them more and more?

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by apwell23 on Wednesday November 22, 2023 @11:20AM (#38381237)
why are you forced to listen to "random" podcasts vs podcasts by people you trust?

This argument is so dishonest its infuriating.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by WendyTheWillow on Wednesday November 22, 2023 @01:09PM (#38382776)
Trust is not a rational behavior, nor is it indicative of reliability of fact.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by apwell23 on Wednesday November 22, 2023 @01:15PM (#38382881)
Sure but that doesn't make it "random" . I don't get why top comment was listening to podcasts knowing full well that you will be given possibly inaccurate facts. I have hard time accepting that podcasts are audible wikipedia, such a strange take is top voted comment.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by WendyTheWillow on Wednesday November 22, 2023 @01:28PM (#38383063)
I listen to podcasts; they’re fun! But I am comfortable operating with incomplete information, and thus know how to treat a low quality source. I also chat with LLMs to better understand topics, and am better off than the folks here who can’t do that as a result.

The main thing I’m getting from this discussion is that a lot more very smart people seem to have deluded themselves into thinking knowledge is objective or “locked in” than I had initially realized. The desire for certainty is an extremely human thing, but it’s a dead end, intellectually.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by apwell23 on Wednesday November 22, 2023 @01:37PM (#38383200)
yea exactly "chatgpt replaced my podcasts" is kind of silly. People don't listen to joe rogan experience to learn facts about how particular jiu jitsu choke works. I don't know what kind of podcasts op replaced with chatgpt but i call BS .
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by akho on Wednesday November 22, 2023 @03:56AM (#38376761)
Is there a similar difference between an LLM getting things wrong and someone shamelessly making something up out of the whole cloth? That's closer to what actually happens.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by JW_00000 on Wednesday November 22, 2023 @06:00AM (#38377642)
I'm pretty sure that in the podcasts I listen to, no one is shamelessly making something up completely.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by colechristensen on Wednesday November 22, 2023 @05:19AM (#38377374)
The kinds of mistakes an LLM makes aren’t nearly as bad as the kind of nonsense you can find humans saying, particularly in podcasts.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by Fatnino on Wednesday November 22, 2023 @05:38PM (#38386187)
Podcasts make stuff up from thin air all the time. Sometimes even maliciously.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by denlekke on Wednesday November 22, 2023 @04:17AM (#38376909)
they definitely do but i think in podcasts i generally have a better ability to evaluate how much trust i should place in what i'm hearing. i know if i'm listening to a professional chef podcast, i can probably trust they will generally be right talking about how they like to bake a turkey. if i'm listening to the hot wings guy interview zac efron i know to be less blindly trusting of their info on astrophysics.

with chatgpt i don't know it's "experience" or "education" on a topic and it has no social accountability motivating it to make sure it gets things right so i can't estimate how much i should trust it in the same way.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by WendyTheWillow on Wednesday November 22, 2023 @04:22AM (#38376946)
I guarantee ChatGPT won't lie to you about how to bake a turkey.

The paranoia around hallucination is wildly overblown, especially given the low stakes of this context.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by taway1237 on Wednesday November 22, 2023 @05:46AM (#38377540)
I don't know how people use ChatGPT at all. It confidently hallucinated answers to 4 out of 5 my latest "real" questions, with code examples and everything. Fortunately with code I could easily verify the provided solutions are worthless. Granted I was asking questions about my niche that were hard enough I couldn't easily Google them or find a solution myself, but I think that's the bar for being useful. The only thing it got right was finding a marketing slogan.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by WendyTheWillow on Wednesday November 22, 2023 @06:03AM (#38377661)
Try asking it about the Roman empire (e.g. “who was Nero?”) then checking the answer.

It’s very good at things like that. Go down a whole Roman Empire rabbit hole, have fun with it!

This is what an idle afternoon talking to ChatGPT is about, not trying to get it to do your job for you.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by controversy187 on Wednesday November 22, 2023 @07:37AM (#38378384)
I've done this and, from what I can tell, it is reasonably accurate. However, I did have an instance where I was asking it a series of questions about the First Peloponnesian War, and partway through our discussion it switched topics to the first part of the Peloponnesian War, which are different conflicts. At least, I think they are. It was quite confusing.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by WendyTheWillow on Wednesday November 22, 2023 @06:08AM (#38377688)
Here, I did it for you:

Nero was a Roman Emperor from 54 to 68 AD, known for his controversial and extravagant reign. He was the last emperor of the Julio-Claudian dynasty. Here are some key points about his life and rule:

1. *Early Life and Ascension*: Nero was born Lucius Domitius Ahenobarbus in 37 AD. He was adopted by his great-uncle, Emperor Claudius, becoming Nero Claudius Caesar Drusus Germanicus. He ascended to the throne at the age of 17, after Claudius' death, which many historians believe Nero's mother, Agrippina the Younger, may have orchestrated.

2. *Reign*: Nero's early reign was marked by influence from his mother, tutors, and advisors, notably the philosopher Seneca and the Praetorian Prefect Burrus. During this period, he was seen as a competent ruler, initiating public works and negotiating peace with Parthia.

3. *Infamous Acts*: As Nero's reign progressed, he became known for his self-indulgence, cruelty, and erratic behavior. He is infamously associated with the Great Fire of Rome in 64 AD. While it's a myth that he "fiddled while Rome burned" (the fiddle didn't exist then), he did use the disaster to rebuild parts of the city according to his own designs and erected the opulent Domus Aurea (Golden House).

4. *Persecution of Christians*: Nero is often noted for his brutal persecution of Christians, whom he blamed for the Great Fire. This marked one of the first major Roman persecutions of Christians.

5. *Downfall and Death*: Nero's reign faced several revolts and uprisings. In 68 AD, after losing the support of the Senate and the military, he was declared a public enemy. Facing execution, he committed suicide, reportedly uttering, "What an artist dies in me!"

6. *Legacy*: Nero's reign is often characterized by tyranny, extravagance, and debauchery in historical and cultural depictions. However, some historians suggest that his negative portrayal was partly due to political propaganda by his successors.

His death led to a brief period of civil war, known as the Year of the Four Emperors, before the establishment of the Flavian dynasty.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by WendyTheWillow on Wednesday November 22, 2023 @06:10AM (#38377704)
I also did a brief fact check of a few details here and they were all correct. Zero hallucinations.

Does this make sense? Notice how little it matters if my understanding of Nero is complete or entirely accurate; I’m getting a general gist of the topic, and it seems like a good time.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by bigDinosaur on Wednesday November 22, 2023 @07:38AM (#38378390)
It may matter little to you that your understanding is not complete or entirely accurate, but some of my worst experiences have been discussing topics with people who think they have anything insightful to add because they read a wikipedia page or listened to a single podcast episode and then decided that gave them a worthwhile understanding of something that often instead takes years to fully appreciate. A little knowledge and all of that. For one, you don't know what you're missing by omission.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by WendyTheWillow on Wednesday November 22, 2023 @01:01PM (#38382660)
It also doesn’t matter to you, unless you’re claiming you only ever discuss topics you’re extremely well versed in.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by Trixter on Wednesday November 22, 2023 @11:54AM (#38381697)
This is missing the broad concern with hallucination: You are putting your trust in something that delivers all results confidently, even if they were predicted incorrectly. Your counter-argument is lack of trust in other sources (podcasts, the education system), however humans, when they don't know something, generally say they don't know something, whereas LLMs will confidently output incorrect information. Knowing nothing about a certain subject, and (for the sake of argument) lacking research access, I would much rather trust a podcast specializing in a certain area than asking a LLM.

Put more simply: I would rather have no information than incorrect information.

I work in a field of tech history that is under-represented on wikipedia, but represented well in other areas on the internet and the web. It is incredibly easy to get chatGPT to hallucinate information and give incorrect answers when asking very basic questions about this field, whereas this field is talked about and covered quite accurately from the early days of usenet all the way up to modern social media. Until the quality of training data can be improved, I can never use chatgpt for anything relating to this field, as I cannot trust its output.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by WendyTheWillow on Wednesday November 22, 2023 @01:03PM (#38382693)
I am continually surprised by how many people struggle to operate in uncertainty; I am further surprised by how many people seem to delude themselves into thinking that… podcasts… can provide a level of certainty that an LLM cannot.

In life, you exceptionally rarely have “enough” information to make a decision at the critical moment. You would rather know nothing than know some things? That’s not how the world works, not how discovery works, and not even how knowledge works. The things you think are certain are a lot less so than you apparently believe.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by denlekke on Wednesday November 22, 2023 @05:39AM (#38377489)
i appreciate your confidence and would love to know how far you would go with the guarantee ! it makes me realize that there is at least one avenue for some level of trust about gpt accuracy and that's my general awareness of how much written content on the topic it probably had access to during training.

i think maybe your earlier comment was about the average trustworthiness of all podcasts vs the same for all gpt responses. i would probably side with gpt4 in that context.

however, there are plenty of situations where the comparison is between a podcast from the best human in the world at something and gpt which might have less training data or maybe the risks for the topic aren't eating an uncooked turkey but learning cpr wrong or having an airbag not deploy

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by WendyTheWillow on Wednesday November 22, 2023 @05:56AM (#38377617)
There are zero podcasts from “the best person in the world”, the very concept is absurd.

No one person is particularly worth listening to individually, and as a podcast??? Good lord no.

LLMs beat podcasts when it comes to, “random exploration of an unfamiliar topic”, every single time.

The real issue here is that you trust podcasts so completely, by the way, not that ChatGPT is some oracle of knowledge. More generally, a skill all people need to develop is the ability to explore an idea without accepting whatever you first find. If you’re spending an afternoon talking with ChatGPT about a topic, you should be able to A) use your existing knowledge to give a rough first-pass validation of the information you’re getting, which will catch most hallucinations out of the gate, as they’re rarely subtle, and B) take what you learn with a hefty grain of salt, as if you’re hearing it from a stranger in a bar.

This is an important skill, and absolutely applies to both podcasts and LLMs. Honestly why such profound deference to podcasts in particular?

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by bigDinosaur on Wednesday November 22, 2023 @07:35AM (#38378367)
It has lied to me about extremely basic things. It abssolutely is worth being paranoid about. You simply cannot blindly trust it.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by WendyTheWillow on Wednesday November 22, 2023 @01:11PM (#38382809)
Good thing nobody here is suggesting blind trust. The mistake being made here is thinking I’m suggesting LLMs are a good way to learn. What I am instead saying is that podcasts are not a good way to learn, and should be treated with the sane level of skepticism one holds for an LLM response.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by superultra on Wednesday November 22, 2023 @05:17AM (#38377357)
One thing that could happen, sooner rather than later, is that agents are deployed that have access to a facial database of information relevant to the topic. So, there could be a GPT of that day’s NYT Daily with a high ranked database of info on, say, Israel and Hamas, and the text synthesis generates an overview but the user can “ask” for clarifying details to drill down, and responses.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by apwell23 on Wednesday November 22, 2023 @11:53AM (#38381686)
Why were you listening to podcasts before when you knew full well that they are inaccurate?
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by superultra on Wednesday November 22, 2023 @05:12AM (#38377321)
I consider the information I’m receiving at a “water cooler” level of factual accuracy.

That said there are a few topics I’ve asked where I know enough to know (I had a grad degree in US history) and I’ve found it’s about on par with what you’d dig up through Google.

I’ve also found recently that it’ll state when it can’t equivocally say something. Or, in some cases, when I have misunderstood something and repeat it back incorrectly to try and clarify, it’ll correct me. 6 months ago, over text interface, it never would have corrected me: it almost always assumed the user was right and went along with it.

But again - it’s not like I’m fact checking Frank at the water cooler (or, often anyway). It’s shooting the shit and it’s great for that.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by mensetmanusman on Wednesday November 22, 2023 @08:42AM (#38378975)
It can't be worse than TED talks, about half of which suffer from the reproducibility crisis (and therefore likely false).
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by superultra on Wednesday November 22, 2023 @05:26AM (#38377418)
My 15-year old loves the Percy Jackson series, and he said that the audio conversation he had with ChatGPT was the first time he felt like like “someone” “got” Percy Jackson, in “real life.” Lots of airquotes there because there isn’t a someone, and ChatGPT doesn’t get it, and what is real even? But the conversation was so good that my 15-year is now totally creeped out by ChatGPT and refused to use it after that that 30 min conversation.

You take about low stakes but fiction is a massive industry. In making what is essentially Star Wars fanfic with ChatGPT, I’ve realized why AI was such a contentious point for the recent writers strikes.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by cosmojg on Wednesday November 22, 2023 @02:34AM (#38376105)
As long as we're entertained, who cares?
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by vore on Wednesday November 22, 2023 @02:36AM (#38376131)
If you're replacing a factual podcast with it, maybe you should care a little...
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by osti on Wednesday November 22, 2023 @02:59AM (#38376316)
How can you be sure the podcast is factual, are you fact checking everything they say on the podcast?
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by GaryNumanVevo on Wednesday November 22, 2023 @03:06AM (#38376368)
Every source of information has a bias, but with ChatGPT that's changing every time you hit "enter"
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by bigfudge on Wednesday November 22, 2023 @03:28AM (#38376540)
1. The primary source of bias will still be the person writing the prompt. The 'most probable completion' for the podcast will depend a lot on the setup. 2. I'm not sure it's going to vary more than a human day to day is it?
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by GaryNumanVevo on Wednesday November 22, 2023 @05:12AM (#38377327)
1. Absolutely not, ChatGPT has a mountain of biases that are simply _uncovered_ by prompting. To call this bias via prompting is intellectually dishonest.

2. No, ChatGPT is borderline schizophrenic. I trust a human and team of writers and producers to be more consistent in their bias and truthiness outright than a do a program that's trained on Reddit / Twitter and has almost no grounding.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by da39a3ee on Wednesday November 22, 2023 @04:30AM (#38377011)
If you've used it a lot this year for coding like many people, you'll have found that you develop the ability to know when it doesn't know what it talks about.

Perhaps you're one of the people who think they're above it, and hence haven't developed that ability?

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by creativenolo on Wednesday November 22, 2023 @08:15AM (#38378715)
And you know not to push it further down the path of ‘not knowing’. And even before your next prompt, you can feel it’s got a foot down the wrong path. Nudge it to fix it, and/or move on.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by resonious on Wednesday November 22, 2023 @05:01AM (#38377224)
Might be able to ask the same question to someone listening to real podcasts.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by icelancer on Wednesday November 22, 2023 @05:11AM (#38377315)
People never consider the base rate. They compare AI things to gods rather than what it is replacing, which is usually a low-value wiki or podcast.
Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by raydev on Wednesday November 22, 2023 @05:18PM (#38385970)
It's more commenters here revealing how low their standards are when they say "well people and/or podcasts spread false info too".

No actually, you can pay people to lie less and prove that they do so. We pay $20/month for ChatGPT to straight up lie to us and we know we need to sort it out.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by colechristensen on Wednesday November 22, 2023 @05:15AM (#38377351)
“These people have no idea what they’re talking about” is a frequent reaction to podcasts I hear. To the point that there are very few I want to keep listening to.

ChatGPT lies to me but only in a specific way.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by yieldcrv on Wednesday November 22, 2023 @05:14AM (#38377342)
> I’ve been using this for several weeks now and it’s replaced podcasts for me. I’ll just pick a topic and then ask for a summary

This is why I could never get “into podcasts”

Which apparently can mean 100 different things, but some popular radio talk show style ones I’ve been exposed to are just two guys rambling about a topic for two hours with lots of filler, where one person is essentially reading a Wikipedia article but getting interrupted every 5 words by the other, to go on - what are supposed to be - comical tangents.

Like, this could have been a 30 second sentence.

Far too frustrating for me.

I get exposed to them on long car rides with other people and that’s shaped my entire opinion.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by tkgally on Wednesday November 22, 2023 @05:34AM (#38377460)
> I’ll just pick a topic and then ask for a summary and then ask clarifying questions.

I made a public GPT for a similar purpose. Some examples of my conversations with it:

https://youtube.com/@Tom_Gally_UTokyo

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by tkgally on Wednesday November 22, 2023 @05:49AM (#38377564)
> It is very trustable about high level things many people know. As the knowledge is more specific or esoteric the less trustworthy it is.

That's my experience, too.

In addition to sticking to general topics, another fun way to talk with it is to discuss counterfactuals. "Hey, GPT! What do you think the world would be like now if Germany had won World War II [smartphones had not been invented, half of all people were born blind, etc.]." Those questions don't have right or wrong answers, and the answers it does come up with can be thought-provoking.

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by controversy187 on Wednesday November 22, 2023 @07:31AM (#38378332)
> "I’ve realized that I’m built to learn socially"

That sentence really resonated with me and sums up a bunch of ideas that have been swirling in my head recently. I've been "interviewing" ChatGPT about world history for a few months now and even turned it into an unsuccessful podcast! I really enjoy learning and creating much more than I would enjoy listening to my own podcast, though :)

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by apwell23 on Wednesday November 22, 2023 @02:53PM (#38384251)
> it’s replaced podcasts for me

Curious. Which podcast did you replace?

Re:ChatGPT Voice for All Free Users Announced (By Greg Brock... by mlrtime on Thursday November 23, 2023 @09:56AM (#38393381)
This remind me of the rick and morty episode, keep summer safe.

https://youtu.be/hguiN8oo0dI?si=8SWsnCMkjZ5bYLH9