News for hackers. Stuff that matters.
Re:Sam Altman's ouster was precipitated by letter to board a... by TeMPOraL on Wednesday November 22, 2023 @08:34PM (#38388058)
Symbolic reasoning isn't an atomic action. I can't speak for you or anyone else, but at least for me, symbolic reasoning involves either cached conclusions, or a fuck ton of talking to myself in my head - and that part is effectively LLM-like.

Which is why I'm still bewildered people expect LLMs to solve math and symbolic issues directly, when they're clearly (see e.g. "chain of thought") better treated as "inner voice" and used accordingly.

Re:Sam Altman's ouster was precipitated by letter to board a... by lovecg on Wednesday November 22, 2023 @10:38PM (#38388952)
A lot of this kind of reasoning is very visual to me and involves no inner monologue of any kind - just visualizations flying around in my brain in complete silence. The translation into words happens later as a separate step. I wonder if this is not a universal experience.
Re:Sam Altman's ouster was precipitated by letter to board a... by pixl97 on Wednesday November 22, 2023 @10:57PM (#38389074)
Some people have no inner monolog, something that blew my mind.

When I work on problems I don't understand I'll monolog it internally. Now when I'm doing things I understand well I have some kind of internal shortcut language (my own token set I guess), that can sometimes make it difficult to explain to other people.

Re:Sam Altman's ouster was precipitated by letter to board a... by Davidzheng on Thursday November 23, 2023 @03:04AM (#38390546)
Can you describe how you would reason about say a paragraph of code--something which is very language based?
Re:Sam Altman's ouster was precipitated by letter to board a... by lovecg on Thursday November 23, 2023 @03:25AM (#38390660)
Depends on what the code is doing! Typically I “see” the underlying concepts or data structures interacting with each other. Imagine those block and arrow diagrams you would have in a textbook explaining how pointers work, except it’s completely automatic for me. My day to day involves a lot of low level systems stuff, so reading a page of code could spawn an image of how various event loops, memory allocations, etc. interact. Then to explain what I’m thinking of to a colleague is sort of like describing what I’m already “seeing” in my mind’s eye. Language to me is just an interface to this inner visual world.