News for hackers. Stuff that matters.
Re:Why Vivaldi won't follow the current AI trend? by pprotas on Friday July 05, 2024 @04:01AM (#40880681)
Seems like a reasonable and thought-out decision to me. Not sure why the comments here are so negative. Clearly LLMs don’t fit into Vivaldi’s vision and the features they’d like to provide to their users.
Re:Why Vivaldi won't follow the current AI trend? by stavros on Friday July 05, 2024 @04:42AM (#40880928)
For me I think it's because the article appears biased. It's not just "we can't think of any problem it'd solve", it's "LLMs are bad and you should feel bad for liking them".
Re:Why Vivaldi won't follow the current AI trend? by pprotas on Friday July 05, 2024 @04:48AM (#40880968)
I don't really have that feeling. The author says that LLMs make stuff up and are often wrong about non-widely known facts. They present hallucinations in a confident way, which makes them come across as liars. This is true. That is exactly what the most popular LLMs do.

They don't say that you should feel bad. The author simply says that the characteristics and unreliability of LLMs make them unfit to be implemented in the Vivaldi browser at this moment. They even close off the article with a positive sentiment about the future of the ML field. They don't burn any bridges there.

Re:Why Vivaldi won't follow the current AI trend? by KoolKat23 on Friday July 05, 2024 @04:59AM (#40881039)
He went on a tangent about plagiarism, may as well disable the copy text feature in the browser.
Re:Why Vivaldi won't follow the current AI trend? by WA on Friday July 05, 2024 @05:18AM (#40881156)
Copying isn't plagiarism. Copying and then publishing the same thing is plagiarism.
Re:Why Vivaldi won't follow the current AI trend? by KoolKat23 on Friday July 05, 2024 @05:19AM (#40881163)
Yes, I agree with you. The author made the point about LLM's facilitating plagiarism not me. My point is, if that is his argument, then copying is the same thing (which is ridiculous of course).
Re:Why Vivaldi won't follow the current AI trend? by plasticchris on Friday July 05, 2024 @10:17AM (#40882974)
The plagiarism argument is not necessarily directed at the user of the browser. Ask yourself who is doing the publishing? And how would you cite the output of an LLM if you did publish the output?
Re:Why Vivaldi won't follow the current AI trend? by KoolKat23 on Friday July 05, 2024 @12:18PM (#40883996)
I could ask the same for the copy function, don't see how this would ever be an issue?
Re:Why Vivaldi won't follow the current AI trend? by freejazz on Friday July 05, 2024 @07:28PM (#40886981)
Typically I'd cite to whatever it was I copied. I've never seen any kind of writing that sourced to the copy function. Have you?
Re:Why Vivaldi won't follow the current AI trend? by KoolKat23 on Tuesday July 09, 2024 @05:25AM (#40914051)
And you can cite the LLM you've used, no different to citing a quote by a person.
Re:Why Vivaldi won't follow the current AI trend? by KoolKat23 on Tuesday July 09, 2024 @08:13AM (#40915176)
And to answer your other question of how,

There's plenty of documentation on that directly from the source (openai, etc.) and elsewhere.

https://apastyle.apa.org/blog/how-to-cite-chatgpt

Re:Why Vivaldi won't follow the current AI trend? by plasticchris on Monday July 15, 2024 @07:06AM (#40966776)
Precisely the point, you cite the model and that’s it. Even when these models are known in some cases to reproduce training text directly.
Re:Why Vivaldi won't follow the current AI trend? by KoolKat23 on Wednesday July 17, 2024 @08:22AM (#40985074)
Humans are known to do that too?
Re:Why Vivaldi won't follow the current AI trend? by stavros on Friday July 05, 2024 @04:53AM (#40880999)
This doesn't sound biased to you?:

> While they do this, they also use vast amounts of energy and are happy using all the GPUs you can throw at them which is a problem we’ve seen before in the field of cryptocurrencies.

Re:Why Vivaldi won't follow the current AI trend? by pprotas on Friday July 05, 2024 @05:03AM (#40881065)
This is written in a way that makes it clear that the author does not like the energy usage aspects of LLMs.

But is he wrong?

Re:Why Vivaldi won't follow the current AI trend? by stavros on Friday July 05, 2024 @05:04AM (#40881076)
Yes. Cars use more energy than LLMs, we don't mind those.

What does "a lot of energy" even mean? It's meaningless. Do they use too much energy for their usefulness? If they did, people wouldn't be using them.

Re:Why Vivaldi won't follow the current AI trend? by timeon on Friday July 05, 2024 @05:19AM (#40881160)
> we don't mind those.

Like with LLMs, some of us do. But still there are places in the world where one is imprisoned without car. Which is not case with LLMs (yet).

Re:Why Vivaldi won't follow the current AI trend? by minasmorath on Friday July 05, 2024 @09:38AM (#40882584)
Really hit the false equivalence nail on the head.

Cars enable long-distance travel, which in many parts of the world is now essential for survival, and often that is, ironically, a result of climate change.

LLMs do nothing to aid human survival. In a post-apocalyptic world, cars would be sought after for both transport and shelter, but nobody would give a care that we lost ChatGPT.

Re:Why Vivaldi won't follow the current AI trend? by nunez on Friday July 05, 2024 @12:42PM (#40884183)
I'm not sure if cars use more energy than LLMs; huge "citation needed" there. But for the sake of argument, let's assume that they do.

Cars use more energy than LLMs because most of the world is built around requiring a car to get to places.

It's not that we don't mind it; quite the contrary, in fact, as we're always reminded of when the price of gas/petrol shoots upwards.

When the cost of living forces you to live 45 minutes away from your job by car because living within walking distance is astronomical, many folks are conditioned to want a house with a garage "for the kids" because apartments are "for the poor," and EVs, in their current state, are not financially feasible yet (though that is changing!), it's more that we're forced to tolerate it.

Re:Why Vivaldi won't follow the current AI trend? by stavros on Friday July 05, 2024 @01:14PM (#40884425)
That's about the cost of energy, not about the consumption. If you don't think the cost of gas is worth it, you don't use a car. If you don't think the cost of electricity is worth it, you don't use an LLM. It's literally priced in.

I know people don't mind the cost relative to the value they're getting, because if they did, they wouldn't use LLMs.

Re:Why Vivaldi won't follow the current AI trend? by freejazz on Friday July 05, 2024 @07:30PM (#40886987)
Is the consumption priced into LLMs? Seems like the free ones are losing money, surely they aren't using no energy.
Re:Why Vivaldi won't follow the current AI trend? by stavros on Friday July 05, 2024 @07:33PM (#40887007)
There aren't LLMs that are free to run.
Re:Why Vivaldi won't follow the current AI trend? by freejazz on Friday July 05, 2024 @09:18PM (#40887501)
Are you giving my post a fair reading or are you trying to state that there are no LLMs that cost nothing to run? I'm referencing the LLMs that let me query them at no cost... It'd seem as if you didn't read my post at all if you thought I was making reference to something else.
Re:Why Vivaldi won't follow the current AI trend? by stavros on Saturday July 06, 2024 @03:59AM (#40888894)
Yes, those LLMs still cost someone something.
Re:Why Vivaldi won't follow the current AI trend? by freejazz on Saturday July 06, 2024 @09:13AM (#40890261)
I know, did you even read my post?? "Surely they aren't using no energy"
Re:Why Vivaldi won't follow the current AI trend? by stavros on Saturday July 06, 2024 @09:40AM (#40890401)
I don't know how clear you meant to be, but it's two sentences. You may want to elaborate, because all I can see in your post is you attacking a straw man of "I can use ChatGPT for free, therefore it must use no energy, which MAKES NO SENSE".
Re:Why Vivaldi won't follow the current AI trend? by freejazz on Monday July 08, 2024 @01:16PM (#40907254)
Are you autistic or something? You're lack of self-awareness is astounding.
Re:Why Vivaldi won't follow the current AI trend? by rsynnott on Friday July 05, 2024 @08:14AM (#40882030)
... But I mean this is the case. What do you mean by 'biased' here? Is it 'biased' to mention bad things about a thing? To be truly unbiased, must one praise everything while glossing over the problems?
Re:Why Vivaldi won't follow the current AI trend? by maniflames on Friday July 05, 2024 @05:08AM (#40881097)
Not sure if it’s biased, it’s a serious limitation of the technology. Some countries are already struggling with their energy grid and water demands as is.

I think it’s fair to ensure that you create something that isn’t subject to possible quotas in the future

Re:Why Vivaldi won't follow the current AI trend? by minasmorath on Friday July 05, 2024 @04:52AM (#40880991)
I took it as more of a recognition of the downsides to LLM tech that the hype train tends to ignore, as well as the legal / moral / ethical gray areas that exist in both training those models and determining who is liable for what they output.
Re:Why Vivaldi won't follow the current AI trend? by stavros on Friday July 05, 2024 @04:53AM (#40881004)
I don't know, this sounds weird:

> While they do this, they also use vast amounts of energy and are happy using all the GPUs you can throw at them which is a problem we’ve seen before in the field of cryptocurrencies.

Re:Why Vivaldi won't follow the current AI trend? by minasmorath on Friday July 05, 2024 @05:01AM (#40881052)
How is that weird? Current energy consumption levels for LLMs are definitely problematic. That's not to say they can't improve, but at the moment it's definitely bad. The estimate of ongoing power consumption for Google's AI summary feature, if it was made available for every search result, is roughly equivalent to the consumption level of the entire country of Ireland. That's not awesome given most of the world is not powered by renewable energy sources.
Re:Why Vivaldi won't follow the current AI trend? by stavros on Friday July 05, 2024 @05:03AM (#40881064)
Don't look at what it says, look at how it's written:

> While they do this, they also use vast amounts of energy and are happy using all the GPUs you can throw at them which is a problem we’ve seen before in the field of cryptocurrencies.

"Vast amounts of energy", "happy using all the GPUs you can throw at them", and then the random cryptocurrency reference to evoke all the bad stuff associated with those.

Re:Why Vivaldi won't follow the current AI trend? by minasmorath on Friday July 05, 2024 @05:21AM (#40881175)
That's how a lot of folks write when they want to make a shorthand comparison and they trust their readers to understand what they're doing. The author is making a comparison of the current cost / benefit of LLM tech to the cost / benefit of Crypto. I don't necessarily agree with that comparison, but using an evocative writing style that can say quite a lot with very few words isn't a problem to me, especially given what this post is intended to convey.

Edit: I do think you're making a fair observation, I just feel there are a few reasons not to draw too strong of a conclusion from it

Re:Why Vivaldi won't follow the current AI trend? by rubslopes on Friday July 05, 2024 @07:09AM (#40881754)
But they said:

> Despite all this, we feel that the field on machine learning in general remains an exciting one and may lead to features that are actually useful. In the future, we hope that it will allow us to bring good privacy-respecting features to our users with a focus on improving discoverability and accesibility.

Re:Why Vivaldi won't follow the current AI trend? by kachapopopow on Friday July 05, 2024 @07:38AM (#40881880)
It's likely because people enjoy the benefits AI brings in their current form. I honestly cannot imagine my life now without gpt4/claude as it saves me hours writing shell scripts and transforming vaguely structured data.

Edit: yes it does make mistakes, but it takes vastly shorter amount of time to find them rather than writing something from scratch.

Re:Why Vivaldi won't follow the current AI trend? by KronisLV on Friday July 05, 2024 @10:02AM (#40882817)
> Edit: yes it does make mistakes, but it takes vastly shorter amount of time to find them rather than writing something from scratch.

To me, it feels like there will definitely be features or even entire products out there that wouldn’t exist without something that lowers the barrier of entry far enough for someone to overcome the zone of proximal development: https://en.m.wikipedia.org/wiki/Zone_of_proximal_development

Just the other day I was able to introduce some custom ESLint rules into the project to make the import names match the filename (e.g. when someone renames a Vue component but the import names don’t change or you don’t notice those usages, so you end up with bunches of <OldComponent /> all over the place). I wouldn’t have had the time to do so without ChatGPT/GitHub Copilot nudging me in the right direction and giving me examples to work off of, because frankly my searches for about 15 minutes didn’t turn up anything either.

Clearly that counts for something because nobody in any of my projects had done that previously, now it’s obvious that basically we need a local package added to the project (in package.js) but also that we can store it in the file system and just use the file: syntax. It was much the same story with some .cjs Node prebuild scripts that remind the developers that they should make examples of the new components they make in a development showcase page and so on.

Aside from that, LLMs are useful for boilerplate stuff (hello, ASP.NET and Spring Boot), as well as simple one shots when you don’t want to rack your brain coming up with a particular RegEx, amongst other cases.

If someone wants an LLM in the browser, good for them! If someone doesn’t want to add them to their browser project, that’s their rightful choice.

Re:Why Vivaldi won't follow the current AI trend? by kachapopopow on Friday July 05, 2024 @05:51PM (#40886351)
I was trying to justify why people have a negative response to it.