I have a feeling it is being used to produce more nonsensical web pages. Often when I am searching the web for information on a product or a review , I land on a page that has weirdly phrased and often repetitive sentences which provide no useful information. I am assuming those pages are generated by OpenAI or similar technology.

The singularity will come when the set of training data available for scrape is dominated by AI generated content and the AI's learnings are derivatives of what old AI's produced.

Human thought on the other hand has some sort of undefinable entropic-value that AI to-date is missing, a Human can produce a "good idea", whereas an AI produces a bunch of potential continuations of a stings of text and selects randomly amongst them (or, even better, a Human selects from them).

Unfortunately the advertising game mixes up the incentives and flips the equation so that the purpose of communication isn't to share a "good idea" as efficiently as possible, but rather to keep eyeballs on your website for as long as possible in the hope some flashy banner ad will distract your user and you'll get your $0.02 for them abandoning your page, likely unfinished. AI will (and already does) excel at this sort of task, but it's the kind of task that ought to have no value whatsoever.

Luckily we have increasingly sophisticated summarization-AI to go from the filler-AI generated crap back down to a couple of bullet points, but at that point you've invested millions of dollars, researcher-hours, engineer-hours, compute-hours, etc, to make the worst text-compression utility of all time.

By the way, it's not just text anymore, you can train GPT-3 on Youtube. You get aligned visual and speech channels and data in vast quantities. That means it's easier to tell if the source is human.

Bingo

It’s increasingly difficult to find product reviews with search engines.

Massive auto generated content farms take a product name and add loads of AI-generated filler text. Pop in a bunch of banner ads and an affiliate link and they have huge economic incentive to scale these operations.

I’m very pessimistic about the direction the internet is going these days. The AI crisis isn’t going to be sentient AI trying to kill us, it’s going to be a flood of noise over knowledge.

Sometimes it works to add "reddit" to your search to find interesting comments. I suppose that will eventually be gamed too.

Until we have to start making AIs to identify knowledge and filter out noise. And then a whole cat-and-mouse game between fake news AI and fake news detection AI.

This is the exact situation we are currently in.

https://rowanzellers.com/grover/

The end result is more robust AI and an understanding of failure modes.

I recall in the mid/late 2000's implementing a markov text generator to create thousands of static html pages based on certain keywords. This has been a problem for over a decade and will probably get worse as text generation tools improve, e.g. GPT-3.

I've got some insight into this (Several friends, now multi-millionaires ran and flipped tens of sites like this) They're mostly written by low paid content writers in 3rd world countries such as Vietnam and the Philippines. Primarily to drive affiliate traffic to Amazon and other retailers with affiliate schemes. They all operate on a similar format - 10 items with good reviews, write 300 words about each product, rinse, repeat, profit.

What a world where people can become multi-millionaires in this way while nurses and teachers can't even get cost of living adjustments.

Right now most of those pages are produced by much simpler models, which copy an existing page and replace text snippets with synonyms. I am sure that soon the spammers will switch to better models.

Had similar experience recently and it had made all the way to be the top Google news hit - apparently the site is cranking out ”news” as SEO spam to promote their app.

https://mobile.twitter.com/moo9000/status/145873329934659174...

been playing with copilot lately and even it just seems more annoying then it is helpful so far. Will continue experimenting but so far my impression has soured a bit

I tried Copilot and removed it from my IDE. Not good enough, only fills in obvious parts and even there makes mistakes.

I often wonder about this with Twitter accounts. How many are already GPT-3 generated?

We'll need another GPT-3 bot to detect the GPT-3 bots.

I integrated copilot with VSCode (it's pretty easy to get off the waitlist I believe) and have been using it to unblock me from my ADHD when I'm writing code. Basically as I think through a bugfix in our app's codebase,

I navigate to the line where I believe "the fix should go here", and a few characters in, copilot is filling up the lines. 80% of the time it is non-compilable, but nearly 50% of the time it's close to the fix I was going to put in. It's then just a matter of me fixing much simpler errors and bugs in the copilot-suggested LOC.

I have found that I get far less distracted from writing bugfixes once I start looking at the code. I'm not going to let copilot push commits to PROD anytime soon, but it's like having a really smart intern who doesn't really know exactly what I'm trying to solve but has a decent idea, pair programming with me.

So it's not like these AI tools will replace me yet, but they are certainly living up to the goal of "copilot".

People are afraid of being replaced when what we actually should be afraid of is be de-valued.

There are subreddits with model-generated porn stories. All the horny people writing for each other are getting automated. In the example I saw some people had sex and then took their clothes off at the end. It's groundbreaking stuff.

That was literally what like 90% of AI Dungeon (GPT-3-based CYOA adventure simulator) players were using it for. Then OpenAI forced AI Dungeon to implement strict content filters, and within a month the community had already stood up a fully functional replacement fine-tuned on literotica with 10 times the features and a focus on privacy and zero content restrictions. The community replacement was partially bankrolled by the sale of AI-generated anime catgirl image NFTs.

That's barely scratching the surface of the AI-generated erotica scene, it's pretty wild.

NovelAI, I presume?

Funnily enough, so long as you aren't trying for porn it does a much better job than AI Dungeon did of staying away from it. It lives up to its name — it's an excellent cowriter for all forms of fiction.

Yup, that's the one. And I agree, it's really good for general use, and if you know how to use the tools right it's arguably better than AI dungeon.

Okay this is legit the funniest thing I read today on Internet

> In the example I saw some people had sex and then took their clothes off at the end.

I mean - that is technically feasible.

The terms and conditions prevent you from making anything good with it. All of my ideas were banned because they're too unethical or just recapitulate the functionality of the sandbox. Some key partners like Microsoft have a separate agreement where they're allowed to make useful things.

You might want to peek at NovelAI.net instead.

It's the exact opposite, in just about every possible way. Including, I'm afraid, model generality -- it's tuned for fiction, and nothing else, but it's very good at that.

Copy.ai uses GPT3 under the hood. Not a product for devs, but still a growing business

There are quite a few similar products that used the OpenAI API as well.

There are plenty of services in the "automate writing ads and blog spam" space. Not making the world better in any way.

We've managed to integrated it well into our software for resumes with positive user feedback

https://www.youtube.com/watch?v=qxk9S2CRsAE&ab_channel=Rezi

Not GPT-3, because it's too big, but much smaller models of similar architecture are used for smartcompose in Word/Outlook GMail/Docs and other places.