News for hackers. Stuff that matters.
Re:John Carmack and Rich Sutton partner to accelerate develo... by FrustratedMonky on Saturday October 07, 2023 @08:54AM (#37801328)
Not sure about everyone else, but I write one word at a time.
Re:John Carmack and Rich Sutton partner to accelerate develo... by ofjcihen on Saturday October 07, 2023 @09:34AM (#37801581)
But are you writing to write or are you writing to convey a thought?
Re:John Carmack and Rich Sutton partner to accelerate develo... by the_other on Saturday October 07, 2023 @09:26AM (#37801537)
You may write one word at a time but the grammar of most languages forces their users to know what they’re going to write several words ahead of the current word.
Re:John Carmack and Rich Sutton partner to accelerate develo... by FrustratedMonky on Saturday October 07, 2023 @11:00AM (#37802258)
Ok. Why do you think GPT isn't doing that? or is different?

It might be calculating the next word, because you can only write one word at a time, but you can't say that the current next word isn't influenced by a few words ahead. Don't think the current understanding of what LLM's do internally can rule that out.

Re:John Carmack and Rich Sutton partner to accelerate develo... by simondotau on Saturday October 07, 2023 @09:13AM (#37801438)
To be fair, I rarely write more than a sentence or two in serial form, and I have often determined the point of a sentence before I write the first few words.

Occasionally the act of writing out an idea in words clarifies or changes my mind about that idea, causing me to edit or rewrite what I’ve already written.

Re:John Carmack and Rich Sutton partner to accelerate develo... by cj on Saturday October 07, 2023 @09:32AM (#37801569)
Do you also think one word at a time?
Re:John Carmack and Rich Sutton partner to accelerate develo... by JKCalhoun on Saturday October 07, 2023 @09:00AM (#37801357)
And often unsure about where I'm going until I get there, ha ha.
Re:John Carmack and Rich Sutton partner to accelerate develo... by dartos on Saturday October 07, 2023 @09:55AM (#37801712)
Yeah but do you write that one word based on the past 1000 or so words that come before it and how each of those words relate to each other with a perfect recollection of each word at the same time?

And if you believe you do that subconsciously, then how can you be sure you don’t subconsciously plan a few words ahead?

Re:John Carmack and Rich Sutton partner to accelerate develo... by FrustratedMonky on Saturday October 07, 2023 @10:58AM (#37802244)
I don't think I do. To a large degree, GPT does write better.
Re:John Carmack and Rich Sutton partner to accelerate develo... by dartos on Sunday October 08, 2023 @03:21PM (#37813584)
Write better as is has more correct and clear syntax, sure.

But it doesn’t write better as in has new, challenging ideas. Or ways to move/relate to humans on a personal level.

GPT writes clear, concise, authoritative, boring, and generic text.

Re:John Carmack and Rich Sutton partner to accelerate develo... by Qwertious on Saturday October 07, 2023 @11:08AM (#37802325)
We ~~all~~ mostly do that partially, but some of us plan our comments ahead and go back and edit previous parts of it after review.
Re:John Carmack and Rich Sutton partner to accelerate develo... by taeric on Saturday October 07, 2023 @01:01PM (#37803375)
Almost certainly not true. Consider pronouns, as they reference other words, therefore cannot be written in isolation. Or simple rules about when to use "an" or "a".

Shaping your words to sound correct is very common. Both in speech and in writing. Sometimes it is finding how to fit a word you want to use into a sentence. Sometimes it is building a rhyme.

You may feel that you go a word at a time, but that really shows how embedded language is.

Re:John Carmack and Rich Sutton partner to accelerate develo... by FrustratedMonky on Saturday October 07, 2023 @01:15PM (#37803522)
Right now we don't know if LLM's are also doing this, or not.

In their calculating the 'next' word, as part of that 'weighting', are the 'simple rules' for future words, that you are saying humans do but LLM's can't.

Re:John Carmack and Rich Sutton partner to accelerate develo... by taeric on Saturday October 07, 2023 @01:53PM (#37803922)
Ah, fair. I was only commenting on the idea that you write one word at a time. Seems fairly unlikely to me. You expand out ideas.
Re:John Carmack and Rich Sutton partner to accelerate develo... by FrustratedMonky on Saturday October 07, 2023 @03:27PM (#37804730)
LOL. Yes, started as a joke.
Re:John Carmack and Rich Sutton partner to accelerate develo... by 4death4 on Sunday October 08, 2023 @04:23AM (#37808756)
It doesn't seem LLMs are capable of "understanding" that they don't "know" something, so there are certainly some observable differences. But the intent of my original comment was precisely to highlight that we don't know. It could be that next token predication is somehow mathematically equivalent to what we call consciousness. That would certainly be a revelation.
Re:John Carmack and Rich Sutton partner to accelerate develo... by ben_w on Saturday October 07, 2023 @01:58PM (#37803990)
I seem to have two parts of my inner monologue, one comes up with complete concepts, the other puts them into words. When I started to notice this, I tried skipping the "make words" part to save time, as clearly I had not only had the thought but also was aware that I had already had the thought. This felt wrong in a way I have no words to describe as there's nothing else like that particular feeling of wrongness, though I can analogise it as being almost but not quite entirely unlike annoyance.

Anyway, point is 80% of this comment was already in my head before I started typing; the other 20% was light editing and an H2G2 reference.

Re:John Carmack and Rich Sutton partner to accelerate develo... by FrustratedMonky on Saturday October 07, 2023 @09:04PM (#37806940)
Sounds kind of like some Zen concepts about moving beyond language. And that language is a faulty method for communicating.