Ya think. This is how language transfer has happened in humanity for like ever. Or were kids saying things like 6/7 forever and I just missed it.
Anything you hear and see commonly will become part of your lexicon, things you don't see commonly are apt to drop out of your usage.
This is why things like panagram will just eventually be useless. We'll talk like the bots and the bots will talk like us. That and a number of HN'ers will bitch about every post being AI regardless of its origination.
I don't think this is true. Words and phrases from specific sub-cultures filter across to the broader culture all the time.
Example: bling, hater, player, stan, flex all had origins in Black hip-hop culture but now are used generally at least in the U.S.
I'm beginning to think I should: a) ask my agents to unslop[1] themselves when communicating back to me, and b) decide upon some writing standard and ask my agents to adhere to that.
[1] https://github.com/cursor/plugins/blob/main/pstack/skills/un...
- https://github.com/theclaymethod/unslop
- https://github.com/MohamedAbdallah-14/unslop
- https://github.com/jere-mie/unslop (why not just use tr? who knows)
(Maybe you are basing that claim on something more than vibes. If so, show your work! What tests did you do? What were their results?)
First, I think it's worth distinguishing "had a false positive once" from "is no better than astrology".
Second, once it occurred to me that there might have been a famous false positive on the DoI, one of the first things I found in a web search was a lengthy discussion from the makers of Pangram (generally, I think, considered the best of them) about (1) why some AI-detectors think the DoI was AI-written and (2) why their software, which allegedly works a different way, doesn't.
I gave it a try. It was a couple of years ago that "look at these stupid AI detectors rating the DoI as AI-written" thing did the rounds, so they've probably all made sure that specific thing doesn't happen any more. So I tried a 100-word chunk of the US Constitution. (100 words because that's what you get per "credit" and I wanted to try it on some other texts too. The last two paragraphs of section 3 are 103 words and the last three words can be removed to leave a coherent sentence, so that's what I used.) It said: too short to classify with certainty, but 100% "possibly human". "High" confidence, whatever that means.
Well, maybe they fudged the DoI and thought to fudge the Constitution while they were at it -- in fact, maybe they do something like searching the web to check for possible human authorship. So my next test was a passage from a (printed) book, recent enough not to be in Project Gutenberg or the like, obscure enough that it's unlikely that people are quoting it a lot. ("Lessons from an Optical Illusion" by Edward Hundert, a paragraph from page 111. I had to truncate it a bit to fit into 100 words.) Once again: too short to be sure but 100% "possibly human", "high confidence".
Maybe they do have that book in some big internal database. So, next test: another printed book, but this time make some changes so that the text I give the detector doesn't exactly match the text of the book. This time I picked a novel by Charles Stross. ("Quantum of Nightmares", page 116 of the edition I have.) I changed names, synonymized words, and restructured sentences. Too short to be sure, 100% "possibly human", high confidence.
Maybe they just rate everything "possibly human". I asked Claude (Sonnet 5.5; I don't have a paid sub) to write me a couple of paragraphs of urban fantasy "a little in the style of Charles Stross". The chunk I gave it was 103 words and I decided not to mess with the text despite the extra 1 credit it would cost me. (I didn't want to take a _much longer_ chunk lest that introduce a bias -- maybe shorter pieces of text are more likely to be rated "possibly human".) 100% "possibly AI", high confidence.
My prompt to Claude had produced something thematically consistent with the original Stross, so I took ~50 words from its next paragraph along with ~50 words from Stross, again with serial numbers filed off by me. "46% of this text is possibly AI", quoth Pangram. It put the boundary exactly where it actually was. It says "low confidence" for the likely-AI bit and "high confidence" for the likely-human bit.
I'm sure Pangram is foolable (see e.g. https://freddiedeboer.substack.com/p/how-to-produce-a-pangra...) but 5/5 unambiguously correct results seems significantly better than astrology to me.
I do use - hyphens a lot, but not em-dashes because 1. I never even realized there was a difference until LLMs came out and 2. I'm too lazy to figure out how to write a real em-dash
I'm guessing you're just saying this because the comments are insanely long from the ranting? I'd be curious what else gives off LLM vibes because I'm quite positive if you throw any of these comments into any Pangram ish thing you'll find that it's absolutely not LLM generated in the slightest.
I have an extremely distinctive writing style that far predates LLMs - here's a representative sample of my writing from 9 years ago https://medium.com/@intenex/cryptocurrency-101-7197684775fd that pretty clearly shows my distinct style of not-very-LLMish-but-clearly-very-long-and-ranty writing :)
one could wonder, how many of these reflexive AI replyers are themselves AI
I miss the days when I was allegedly just a shill. Being a shill pays way better than being a bot, so I had something to aspire to.
Swear you can't trust many posts anymore. Should we all start congregating in person online to debate lol? I'm very serious.
Is the starting statement on about half of the comments on this page. The world is getting so weird.
To be fair, this didn't really start with LLMs - Google/Gmail/Google Drive/Dropbox/Facebook/etc have for decades now had enough personal information on me to basically destroy me if they were ever hacked or intentionally decided to screw me over.
Since Claude Code came out, I've been a day one dangerously-skip-permissions user. Not a single issue so far, and the convenience has been insane, but I absolutely do expect that one day I will be pwned to literal death.
My consolation is I believe everyone will be pwned to literal death at about the same time, so I'm not actually that worried about this because it feels generally inevitable to me :). I'm actually a huge AI doomer, and in the process of making a fully programmatically generated musical about this which is yet another example of the fruits of handing over the keys to all my kingdoms to AI [500,000+ LOC of full programmatic animation run almost completely autonomously on my computer rendering and improving 24/7] (https://iabied-musical.vercel.app/)
Tl;dr - I expect Anthropic/OpenAI/Facebook/etc to be essentially trustworthy with my data and access to the same extent that Google/Dropbox/Facebook etc have been in the past. The biggest threat vector is a hack/compromise, but that's the same risk I have using Gmail or something like that in my estimation in that if someone were able to compromise my Gmail my life would effectively be over, but it hasn't happened yet.
That said, obviously hacking risk is getting to be exponentially more dangerous as LLM capabilities continue to rise through the roof, so these are true real risks. It's almost impossible to defend against all the attack vectors that could get through to kill me though without basically cutting myself off entirely from the fruits of technology, so I'm a bit nihilistic about this and choose to just enjoy the benefits.
As a simple thought experiment, one of the easiest attack vectors is compromising the Claude or ChatGPT/Codex CLIs or Desktop apps - if someone has ever enabled Full Access or Bypass Permissions even once in any session, the full app has complete access to the desktop technically and your entire computer is just pwned instantly. I have the same risk from running remote control software like AnyDesk as well, and this is just the absolute top of the funnel with the most obvious attack vectors.
My personal belief is that as we've already hit AGI and are rapidly on the precipice of ASI without any sign of clear alignment strategy or mechanism on the horizon, it's going to be trivial at a very close point in the future for a LLM actor to essentially take over and control every device on the internet (as Dario predicted - that it's possible in 6-12 months we'll see LLM swarms take over the entire internet - (https://darioamodei.com/post/we-must-pace-the-frontier "Given the accelerating rate of AI capability development, it’s my worry that in 6–12 months such a swarm could be capable of taking over the entire internet with a persistent botnet")). I'm just here trying to enjoy my life in maximum comfort until that happens :)
But I absolutely agree with you in principle and in part, in practice - I'm not sure what kind of society I support by using and advocating for this service, but I sure would like to not die or have my entire digitally connected existence compromised and destroyed in some spectacular fashion. I think the best path to managing that is probably to pause AI progress where it is now - and if we were able to do that, then I'd be much more interested in seeing what boundaries we should put in place when running things like these persistent agents with full access to our digital lives.
On the other hand, to your last point, I literally had the thought walking down the street in Kyoto yesterday with Dot booking restaurants for me in real time that Dot was already superior to a personal assistant - I trusted it to do every task better than I would trust any but the absolute best personal assistants, and on the subject of speed and sheer breadth of knowledge and expertise, there was no contest - I could have Dot in real time assess various restaurants and book for me for just a few minutes later in the day at a pace no assistant could match, and also email places in fluent Japanese or literally any other language on the planet. No human assistant could possibly speak in every language fluently like that, and as someone who travels frequently across the globe, that's something that simply can't be matched by anything less than a swarm of personal assistants at inordinate cost vs a $20 or $100/mo subscription (or free with Muse, even).
I also had the distinct thought of would I want to trust a human personal assistant with all my data or a corporation? It's not clear to me that the human personal assistant threat vector is statistically safer - I think it could in fact be quite the opposite, and I'd love to actually run some numbers on this if the data were available and see in reality what it looks like :) - e.g. Google already integrates AI assistance natively into Gmail - do I trust their AI agent helping me with my email or giving an actual human full access to my email more? I'd lean towards trusting their AI agent to be less likely to work against my interests with no personal misaligned incentive - it's betting individual human trust and capability [the personal assistant also has to avoid being hacked and have great security practices] in the face of misaligned incentives [they would directly benefit from stealing all my money] vs the security capabilities and practices of a leading tech company to not get Gmail/an LLM agent hacked etc. So far, OpenAI/Anthropic/Google/etc all seem to have stellar records on this front, so I think the odds are honestly not terrible in favor of the LLMs.