News for hackers. Stuff that matters.
Re:Tacit Knowledge Is Dangerous by tikhonj on Tuesday December 12, 2023 @11:46AM (#38614646)
Tacit knowledge is inevitable... but it's also different from what this article is about. Tacit knowledge is the kind of knowledge (and skill!) that cannot be fully explained or taught in words—think mechanical skills you can only pick up through physical practice or very context-specific expertise you only get through experience. In programming good taste is crucial and entirely tacit: we can try to distill taste into words and write books about it, but it will never be enough.

Tacit knowledge is not the same as explicit knowledge that just happens to not be documented. Tacit knowledge is not documented because it is undocumentable. You cannot avoid tacit knowledge. Human language fundamentally cannot express all the knowledge that experts develop through years of practice and experience. Even if an expert can express their experience, there are simply ideas and skills that people cannot learn exclusively from words.

This is an important distinction. Trying to eliminate undocumented explicit knowledge is useful for teams. Trying to eliminate tacit knowledge is disastrous. I've seen attempts to make tacit knowledge legible to management—it is one of the most direct ways to sabotage your own experts because experts fundamentally cannot make all their knowledge explicit. Expertise is tacit knowledge and tacit knowledge is expertise.

People generally understand that design by committee or design by regulation has awful results; one of the main reasons for this is that committees require decisions to be fully explicit and explainable—which hamstrings creative problem-solving and pushes for poor design decisions. Exclusively explicit processes get you lowest-common-denominator results: not the lowest common denominator of the expertise present, but the lowest common denominator of what people can explicitly communicate and understand, which is even lower! If you don't let experts be experts, you won't get expert-level work.

Re:Tacit Knowledge Is Dangerous by chongli on Tuesday December 12, 2023 @12:22PM (#38615263)
I think almost all knowledge is tacit knowledge. Even stuff that would seem obviously explicit like mathematics and language.

In my experience tutoring high school students, I’ve encountered plenty of students who struggle with spelling, grammar, or mathematical mistakes and no matter how many times I correct them it doesn’t stick. Then I see other students who pick these things up so quickly without correction.

Mathematics, especially, seems to have a strong tacit component. If all you do is read the textbook you’re going to bomb the exam. You need to practice a lot to develop your mathematical intuition.

Re:Tacit Knowledge Is Dangerous by quacked on Tuesday December 12, 2023 @01:05PM (#38615904)
> I’ve encountered plenty of students who struggle with spelling, grammar, or mathematical mistakes and no matter how many times I correct them it doesn’t stick. Then I see other students who pick these things up so quickly without correction.

I often wonder about this. I believe that each person has a certain intellectual threshold beyond which they cannot progress farther in (memory, spatial reasoning, logical reasoning, learning speed, etc.) Logically there are genetic and natural components to this threshold. I also think part of what makes a lot of modern life so disastrously ineffective is the belief by those running society that everyone can reach a similar intellectual level given the right "system".

However, I think modern schooling is so brutally ineffective that barely anyone in school is operating near the real limits of their intellect. What do you think was holding those kids back? Lack of motivation, poor knowledge of fundamentals, or do you think basic high school concepts actually had maxed out their intellect?

Re:Tacit Knowledge Is Dangerous by nyrikki on Tuesday December 12, 2023 @02:15PM (#38616912)
As someone who suffers from dysgraphia, which isn't well understood and commonly missed or completely misunderstood, our teaching methods simply do not translate to effective methods.

In English especially where we have problems with vowel shifts multiple source languages and frankly stupid spelling of some words by ignorant prescriptivist Latinophiles, it is really rote memorization.

Math is like playing the guitar or skiing, it takes practice to be good at.

But if you aren't good at memorization of concepts you don't understand, the typical response is to make people spend more time with memorization.

This simply doesn't work and students start to believe they aren't smart enough and give up, because they aren't offered tools to adapt and it is easier to just be thought of as stupid or slow.

Mathematics, logic, and scientific reasoning are learned skills and while everyone will have ultimate limits to their abilities, they are hard for all humans but in different ways.

But you are right, most this is tactic, people just ignore factors that often aren't even learning disabilities, but are advantages some students have due to their history and exposure.

Moravec's paradox is probably a good analogy, where what we think is easy is only easy due to previous experience.

Many authors like Ernest Hemingway and Agatha Christie were horrible at spelling and grammar but had good editors.

Assuming that being bad at spelling and grammar indicates an 'intellectual threshold' is a dangerous path.

Calculus is a filter class because it is taught in a way that favors rote memorization of unexplained concepts, but introduce some abstract algebra concepts to a student or coworker and many can move forward.

Rote memorization does have value, but equating memorization skills wilh ultimate intellectual ability leads to far lower educational attainment for many people.

Great guitarists and other difficult skills are far less about 'natural abilities' than it is about hard work and being exposed to an environment that does discourage that hard work.

Stem is the same as is creative writing or effective communication.

It is hard for everyone to learn, but people forget how much effort it took.

Re:Tacit Knowledge Is Dangerous by andsoitis on Wednesday December 13, 2023 @01:00AM (#38623267)
> Moravec's paradox is probably a good analogy, where what we think is easy is only easy due to previous experience.

One explanation of Moravec’s paradox is based on evolution. Human skills are implemented biologically with mechanisms that have been shaped by natural selection. The older the skill, the more time natural selection has had to shape it. Abstract thought is a recent development, so we should expect the current implementation to be relatively inefficient.

Re:Tacit Knowledge Is Dangerous by toast0 on Tuesday December 12, 2023 @09:41PM (#38621985)
> I also think part of what makes a lot of modern life so disastrously ineffective is the belief by those running society that everyone can reach a similar intellectual level given the right "system".

Well, it's a nice belief to have, even if it's not true. But I think what's worse is the belief that everyone can reach a similar intellectutal level given the same "right system".

I'm pretty sure no system could teach me how to say draw legible sketches of pretty much anything, a valuable, intellectual skill. I'm ok with that and will move on with my life. But I'm even more sure a system that could teach me that skill would be unable to teach very many others. If you want to get everyone to the same intellectual level or maybe to at least some specific level, you've got to be flexible about how and what to teach and how long it's going to take.

I know plenty of people who can do basic 3d sketching with no specific instruction, but that's not me. I've got things I can pick up too. Some people are going to need a lot more time for things...

But schools will say they want to do flexible, student driven teaching, but then it's more of the same one size fits some.

Re:Tacit Knowledge Is Dangerous by v-erne on Wednesday December 13, 2023 @06:23AM (#38625755)
>>I know plenty of people who can do basic 3d sketching with no specific instruction, but that's not me

I used to think that I am tone deaf and have no memory for melodies. Bu t after I forces myself to spend a lot of time singing, playing guitar and listening to music it occured that I just lacked some basic skills that combined suddenly creates magical ability of recalling melodies in my head and even repeating them. The same was with drawing and public speaking and general movement coordination (strength training can do wonders in this department).

This made me believe that some of problems of education system comes from general inability to convince students to spend more (dozen times more) on practicing basic skills (being this writing, small/big motoric skills, logical thinking oraz even some seemingly unimportant stuff like voice emission)

Re:Tacit Knowledge Is Dangerous by DrScientist on Wednesday December 13, 2023 @09:42AM (#38628035)
I think there are three things here - which are not mutually exclusive.

1. No amount of practice will enable me to break the 100m world record - or even probably be within 30-40% of it.

2. However, training would dramatically improve my time.

3. Most importantly, in life I could beat Usain Bolt by simply starting running 5 seconds earlier - ie for most things peak performance isn't what matters - it's effort/persistence.

Re:Tacit Knowledge Is Dangerous by quacked on Wednesday December 13, 2023 @09:57AM (#38628254)
Which were the basic skills you thought you were lacking in terms of remembering tone?
Re:Tacit Knowledge Is Dangerous by v-erne on Wednesday December 13, 2023 @02:16PM (#38632670)
I really do not know the proper name here but it is akin to visualisation (but with music). I could not recall intervals and rythm that makes given song recognizable (could not replay the song in my head) just like if you lack visual imagination you cannot solve even the easiest geometric problems without pen and paper or create good shape composition plan for painting.

And basing my intuition on example of one (me) both visual and tone imagination and memory can be developed from almost zero.

Re:Tacit Knowledge Is Dangerous by quacked on Wednesday December 13, 2023 @03:14PM (#38633557)
How did you develop them from zero if you were missing those basic skills?

I am a musician and I'm keenly interested in music education. I believe you when you say that you lacked some basic facilities; I think it's rare, but more common than people think that someone is genuinely tone-deaf, or can't "visualize" pitches and intervals, or can't memorize songs, or can't feel a rhythm. I always wonder if those deficiencies can be overcome. I'm really interested in your tale, if you wanted to write more privately, would you consider sending me an email? It's in my HN profile.

Re:Tacit Knowledge Is Dangerous by v-erne on Friday December 15, 2023 @06:26AM (#38653077)
>> How did you develop them from zero if you were missing those basic skills?

It is really hard to answer this question because it seems that they were an emergent property of dozens of hobbies that I had (I tend to be seriali hobbyist). Seems like trying to explain how I did learn to ride a bike - I can name few basic skills that are required, but showing which exact part of learning bike riding made it stick is no easy task for me (I remember it as trial and error process and this was the same with my children - they just practiced riding bike and the skills developed thanks to them sticking to the practice). It all looks like a kind of tacit knowledge that can only be developed by pure practice (melodic memory through remembering and playing songs, aesthetics through creating your own compositions, logic through solving problems)

My own story is rather simple - I used to play guitar, a bit of keyboard, sing using karaoke, listening to songs paying full attention and than playing guessing games aking to local tv game called "What melody is this?". At first I was awful at this. But then something changed; I started to notice that I can recall melodic and rhythmic structure of some songs - and this was totally new ability to me (I remember that as a kid I was made fun of by my peers that I could not recognize any songs and my singing voice was wildly out of tune).

One caveat though - It's not like I am any good at music - I estimate that getting to level where others would tell "wow you are good" will take at least another 10 years (and it is not that important because I prefer the journey part, not the destination). But still I know I was a lot worse before forcing myself to learn. And probably if I would get a teacher that would motivate me and give feedback I would get here a lot faster, but as I said - it's the journey, and I really like to learn everything myself.

The message here is that I do not think that most people are unable to learn this kind of skills (those being music, logic or even simple aesthetics). The problem is that most do not have the drive, will or simply the time to stick with practice to overcome their own limitations.

Re:Tacit Knowledge Is Dangerous by kwere on Wednesday December 13, 2023 @02:33PM (#38633001)
>that everyone can reach a similar intellectual level given the right "system"

False on absolute terms and useless for most "real life" training. Time to learn/master a subject is an enormous competitive advantage to foster, as "talented" people will always have an edge over "clumsy" people. Mediocre people can only beat a genius trough effort of luck IF the genius is lazy and/or unlucky.

Re:Tacit Knowledge Is Dangerous by panarky on Tuesday December 12, 2023 @01:03PM (#38615882)
>> Tacit knowledge is not documented because it is undocumentable

> students who struggle with spelling

The ability to spell correctly is not tacit knowledge.

>> Tacit knowledge is not documented because it is undocumentable

Spelling is thoroughly documented.

Re:Tacit Knowledge Is Dangerous by nyrikki on Tuesday December 12, 2023 @02:26PM (#38617069)
Like "i" before "e", except after "c"?

While "i" does come before "e" nearly 75% of the time—even after "c" it is a probabilistic rule and not particularly useful.

So not so well documented.

Or how about the false rules that people tried to copy from Latin to English that don't really apply like double negatives or split infinitives.

Shakespeare loses most of its humor in modern edited versions, he used spelling and homonyms artfully when he cared at all. Look at the first folio version if you haven't.

Standard spelling is useful, but neither fully documented nor close to logical.

I think you will find that actual linguistic scholars error twords descriptivism vs prescription.

Only the less informed population of lay people stick to the prescription model as a proxy for intellectual ability.

Re:Tacit Knowledge Is Dangerous by Izkata on Tuesday December 12, 2023 @03:43PM (#38618195)
> Like "i" before "e", except after "c"?

> While "i" does come before "e" nearly 75% of the time—even after "c" it is a probabilistic rule and not particularly useful.

That's only the first part of the rhyme. The second part is "or when sounded like 'a' as in 'neighbor' or 'weigh'", which handles most of those exceptions.

There's even a third part I remember hearing once, but can't remember it now.

Most English spelling/pronunciation rules are never explicitly taught, but they do exist - it's why "ghoti" isn't pronounced the same as "fish", to get that pronunciation you have to break at least two rules.

Years ago I found a page that listed like 40 or so English pronunciation rules that had to do with combinations of characters and where they appeared in words, it was really thorough and I wish I'd kept a link to it.

Re:Tacit Knowledge Is Dangerous by deathanatos on Tuesday December 12, 2023 @03:15PM (#38617764)
> So not so well documented.

You're criticizing a rule of thumb, here. Sure, the rule of thumb isn't perfect … but it also never claimed to be.

But from that, you're drawing the illogical conclusion of "spelling isn't documented", which … the aforementioned rule has no logical connection to.

Plenty of dictionaries exists, good ones, ones that even document non-standard spellings or local variants.

> I think you will find that actual linguistic scholars error twords (sic) descriptivism (sic) vs prescription.

I'll highlight the irony, but this is besides the point, but doubly so when teaching someone how to write. You start with the prescribed spellings, and once the skill is mastered, or the language evolves, then either they know when to break the rules, or the new spelling is simply trending towards prescribed.

… it's the same for a lot of pursuits: in dance, we teach footwork first. Later, you learn when to bend the rules, and when to outright break them. I'd say it's the same in music, too.

> Only the less informed population of lay people stick to the prescription model as a proxy for intellectual ability.

This really isn't what upthread is trying to say, at all. If I had to rephrase it, they're suggesting that, when you teach spelling, some "get it", some don't, even repeatedly, and questioning whether there is some tacit knowledge that the first group has formed that the latter is struggling with.

I taught CS, and I'd say there is a similar pattern amongst students there. Some intuitively seem to get it — particularly, once given the rules for syntax, ifs, while, etc., how to synthesis new programs to solve until-then unseen problems. Yet other students struggle with this. (The closest I've come is "the former have a decent rule system/model in their heads, and the latter are just trying to bum by on heuristics.)

Re:Tacit Knowledge Is Dangerous by nyrikki on Tuesday December 12, 2023 @02:35PM (#38617210)
Random cite describing the difference:

"Prescriptivism is the term used for approaches to language that set out rules for what is regarded as “good” or “correct” usage. Descriptivism is an evidence-based approach to language that describes, in an objective manner, how language is being used. Most contemporary academic linguists are descriptivists, but prescriptivist approaches abound in schools, style guides, internet comment threads, and parental chidings. This case examines attempts to govern, reform, and/or reimagine English."

https://exhibits.lib.ku.edu/exhibits/show/english-language/g...

Re:Tacit Knowledge Is Dangerous by mnsc on Tuesday December 12, 2023 @01:35PM (#38616346)
It is thoroughly documented, yet alot of people make spelling mistakes and we sometime make up animals to mock people who spell stuff "as it sounds in their heads". And then there's people who are good spellers, whomst wouldn't blink twice or use Google when asked to spell "accommodate" or "nausaeus". Do you think that these mega spellers can document _how_ they spell correctly all the time? Or do you think they have some good intuition/tacit knowledge?

English is my second language so I tried to make some funny mistakes above due to the topic, but there might also be some unwanted/undocumented ones thrown in for good measure.

Re:Tacit Knowledge Is Dangerous by aleph_minus_one on Tuesday December 12, 2023 @02:13PM (#38616878)
> Do you think that these mega spellers can document _how_ they spell correctly all the time?

At least in my native language, I can typically explain the rules why a word is spelled the way it is. The simple reason for this is that I am interested in the structure of languages. The typical reason that I experience among other people why they spell words wrong is that they are less interested in this topic.

Re:Tacit Knowledge Is Dangerous by chongli on Tuesday December 12, 2023 @02:29PM (#38617111)
There are rules for English spelling. They’re just extremely complicated because English, in addition to all its Anglo-Saxon native words, has many loanwords from other languages: Norman French, Latin, Greek, German, and many more. To spell a word correctly it really helps to be able to identify its language of origin. If you watch the Scripps national spelling bee, you’ll regularly see the spellers asking about this information.

Of course, tons of everyday great spellers don’t know about any of this stuff explicitly. They just seem to tacitly have a “feel” for the language of origin and are thus able to spell many words when first hearing them.

Re:Tacit Knowledge Is Dangerous by nyrikki on Tuesday December 12, 2023 @03:04PM (#38617638)
Lots of words have odd spelling due to false etymologies.

Scissors, Island, Ache, and Could; were all from old English with random letters added by people in the 15th century who mistakenly thought they were from Latin.

Etymology is hard, and most textbook writers and teachers who invented the rules weren't qualified to actually find the true origin.

English accumulated a multitude of inconsistent spelling patterns, some from loan words, some from shift how words pronounced from vowel shifts, yod-dropping, and random reform attempts which weren't often based on rigourous evidence of origin.

It was an etymological fallacy that drove those spelling reforms to 'correct' the spelling anyway.

There is no real value in keeping the k in knife when the sound was dropped as an example.

Re:Tacit Knowledge Is Dangerous by chongli on Tuesday December 12, 2023 @04:42PM (#38619023)
Lots of words have odd spelling due to false etymologies.

That's true as well.

It was an etymological fallacy that drove those spelling reforms to 'correct' the spelling anyway.

There is no real value in keeping the k in knife when the sound was dropped as an example.

To me, these two statements suggest opposite recommendations. The first tells us that we should be cautious of prescriptive changes to spelling. The second that we should go ahead and drop the k in knife (and presumably change the spelling on all other words to be more phonetic).

I am inclined to be conservative here [1]. I found Mark Twain's satirical piece on the issue [2] rather persuasive. Like it or not, those old prescriptivists' changes have become part of the etymology. Making further changes for the sake of easier spelling would only complicate the etymology even further, and make it even harder for future English-speakers to read the texts of today.

[1] https://xkcd.com/927/

[2] https://faculty.georgetown.edu/jod/texts/twain.html

Re:Tacit Knowledge Is Dangerous by watwut on Wednesday December 13, 2023 @02:41AM (#38623871)
A lot of then simply remember well. That is not tacit knowledge, that is explicite knowledge.
Re:Tacit Knowledge Is Dangerous by athanagor2 on Tuesday December 12, 2023 @02:24PM (#38617045)
> Mathematics, especially, seems to have a strong tacit component.

It’s quantifiers, and bound and free variables.

Re:Tacit Knowledge Is Dangerous by ekidd on Tuesday December 12, 2023 @12:49PM (#38615668)
> very context-specific expertise you only get through experience.

When giving advice, I'm often tempted to point to a given situation, and to explain what rule of thumb I used to solve it.

But then I would see a junior programmer applying the rule of thumb in a completely different situation and I'd want to say, "No, that will end in tears!" And I realized that a lot of my rules of thumb were really dumb when taken out of context.

As far as I can tell, a huge part of expertise is having a large set of mappings like:

- In contexts like "C1", use rule of thumb "R1" or "R8".

It's very tempting to talk about R1, R2, etc. You can write blog posts like, "How R2 will transform your team!"

But a lot of real expertise comes from being able to say, "Oh, this is a combination of C7 and C78, so I should consider rules of thumb R7, R49 and R102. Ah, wait, no, R49 is just gross here."

So I've learned that, when mentoring, I need to spend a lot more time talking about the context before proposing any rules of thumb.

Re:Tacit Knowledge Is Dangerous by enasterosophes on Tuesday December 12, 2023 @02:56PM (#38617534)
This is very insightful, thanks. I'm currently in the middle ground where I still want mentoring from the technical leads on some things, but I also have enough seniority to be mentoring new hires. You've articulated the way I think our tech leads are often not great at explaining themselves, while also giving me something to think about when passing on information to newbies.
Re:Tacit Knowledge Is Dangerous by smilliken on Tuesday December 12, 2023 @02:59PM (#38617572)
My rule of thumb is to hesitate before giving advice if I can't come up with an anecdotal story to support it. Stories are more useful than generalizations because they come with the context, and can be dismissed in different contexts. At risk of presently breaking this rule of thumb, I'll give an example. When I notice code being structured with class inheritance, I'll point out a part of the codebase where I did similar, and how poorly it turned out, which someone can observe for themself. It started out nice, as it usually does, but devolved over time as complexity accumulated in parent classes to handle scenarios in child classes.
Re:Tacit Knowledge Is Dangerous by AnimalMuppet on Tuesday December 12, 2023 @03:15PM (#38617763)
Um, can I retract about the last 15 years of my advice?
Re:Tacit Knowledge Is Dangerous by fidotron on Tuesday December 12, 2023 @11:53AM (#38614772)
This.

This article confuses tacit knowledge for the phenomenon most eloquently described by a former (superb) sysadmin colleague “documentation is the enemy of job security”.

Re:Tacit Knowledge Is Dangerous by pheres on Tuesday December 12, 2023 @12:41PM (#38615552)
One should not look to be unreplaceable, but rather the opposite.

Only when you become replaceable at a certain task (or able to delegate it) you can progress to do new (more interesting) things.

Re:Tacit Knowledge Is Dangerous by geodel on Tuesday December 12, 2023 @12:53PM (#38615726)
It could go either way. Some places will like and promote one to do different/more interesting things. Other places will eliminate the position with k, thx, bye! Moreover usually people have only so much energy to be always concerned with job / career growth/ changes etc. They are fine their little pieces of knowledge that make them useful at work in a unique way.
Re:Tacit Knowledge Is Dangerous by oceanplexian on Wednesday December 13, 2023 @12:07AM (#38622937)
If your company has a habit of firing people that share information, or punish employees who work smarter instead of harder, it’s a sign that they might be out of touch with value creation and will eventually be punished by the market.

Being fired from such a place might actually be a blessing, not a curse.

Re:Tacit Knowledge Is Dangerous by justin_oaks on Tuesday December 12, 2023 @01:58PM (#38616673)
Is this true, though? After seeing enough bone-headed management decisions, I wonder if the bosses even know or care about documentation when making decisions to fire someone.

From my point of view, the lack of documentation might be a reason to fire someone.

Re:Tacit Knowledge Is Dangerous by nonrandomstring on Tuesday December 12, 2023 @12:15PM (#38615151)
Documentation makes the world go round. Definitely appropriate for high-risk must-deliver projects, but not in all contexts. Is it maybe a business fantasy that we can simply juice the talent of a team and bottle it?

Where does this idea come from other than good engineering practice?

If you work with smart, talented people in a fast moving world it seems, as you say, inevitable that you face the "problem" of tacit knowledge and manage it positively.

In Designing Sound (and my lectures on sound design) I researched and wrote about this as "ineffable knowledge". My observation in arts and design through the 90s and early 00s was that we regularly get people who are x100 superstars but they're unable to articulate exactly how they do things and pass that knowledge to others (I was researching this from a UI/UX point of view). That is /talent/ and it's why we value people as more than just interchangeable cogs. Much process knowledge, and crucially problem-solving knowledge in any project will reside in the heads of individuals.

(TBF I think the article is more about tacit cultural knowledge within the team as a whole)

Sure if we lose key individuals the project is threatened, but on the other hand trying to get them to do a full knowledge dump, such that any replacement would be frictionless, is a fools errand.

Treating "information" that way and ignoring people is one-dimensional thinking.

So I don't think it's helpful to talk about tacit knowledge itself as "dangerous". What is more dangerous is composing mediocre teams only from replaceable workers and spending too much of their time on documenting as a safety net when they should be pushing forward. Meanwhile a danger is in treating valuable people so badly their continuity is not assured. Far fewer people fall under the proverbial bus than simply leave for better jobs.

So we could take the view that over-cautious self-reporting and documenting is a sign of, and attempt to manage, low commitment business attitudes, poor wages, conditions and low job-security.

Re:Tacit Knowledge Is Dangerous by pixl97 on Tuesday December 12, 2023 @02:45PM (#38617331)
Documentation is one of those things that once there's a lot of it, it's its own product.

First, you have to have someone constantly making sure it's up to date in the case of software. Really easy for it to go stale and just be wrong, and possibly actively harmful.

But then telling someone "RTFM" has a different quality if you're talking about 50 pages or 50,000 pages. Cool, I'll get back to you in a month.

Re:Tacit Knowledge Is Dangerous by CrypticShift on Tuesday December 12, 2023 @12:43PM (#38615583)
This is so meta. Here we are trying to verbalize our tacit knowledge of "tacit knowledge" :)

While I agree with the distinction you made (Last paragraph is excellent), there is this grey area : Because in the digital era almost everything is recorded (oral meetings/written chitchat...), there is a huge quantity of information that is neither in the "Guts" nor in the "docs". To join others in this thread, I guess LLMs will play a big part in making this grey area usefull and in a certain way bridge the gap (partially) between what is tacit and what is formally documented.

Re:Tacit Knowledge Is Dangerous by Lutger on Tuesday December 12, 2023 @01:14PM (#38616041)
Exactly. However I think its a bit more complicated than a grey area. There is just no hard distinction between tacit and explicit knowledge, even though the distinction is useful.

It is not that any tacit bit of knowledge eludes articulation, it is the whole that is problematic. Nothing is truly undocumentable, but its like the specs for microsoft word: its just so much you already need to be an expert to navigate the whole of it.

Thats the distinction and LLM of course of very good at processing vast amounts of bits and pieces.

Re:Tacit Knowledge Is Dangerous by jessriedel on Tuesday December 12, 2023 @12:21PM (#38615240)
Thanks, this is the exactly correct critique of the article.

I'll just add that the author did not seriously grapple with the fact that leaving at least some explicit knowledge undocumented is inevitable. There is no sharp divide between "explicit knowledge every programmer should know" and "explicit knowledge that only makes sense in our organization". Documenting is costly to produce, and documentation is costly to maintain even after it is produced. (If nothing else, more documentation makes it harder to search.) This holds even if it's simultaneously true that large organizations usually document insufficiently because of laziness and bad incentives.

Re:Tacit Knowledge Is Dangerous by er4hn on Tuesday December 12, 2023 @12:47PM (#38615637)
I agree that some is inevitable, but as that amount increases it will provide a drag in what the organization is able to accomplish. This becomes even worse as an organization is remote locally and globally spread out.
Re:Tacit Knowledge Is Dangerous by k_process on Tuesday December 12, 2023 @03:39PM (#38618143)
The challenges with the post's suggestion are (1) it accounts only for the time of the person needing information, not the one providing it, and (2) a specific question takes a small time to answer, but pre-documenting everything that is needed to answer any question takes orders of magnitude more time.

Some of this is outlined in Snowden's (not that Snowden) Laws of Knowledge Management.

http://www.gurteen.com/gurteen/gurteen.nsf/id/km-seven-princ...

These two are especially relevant:

2. We only know what we know when we need to know it.

7. We always know more than we can say, and we always say more than we can write down.

Re:Tacit Knowledge Is Dangerous by nullhole on Tuesday December 12, 2023 @12:20PM (#38615226)
It's worth noting a tautology: tacit knowledge is undocmented because it is undocumentable.

The key insight (which I agree with!) is that some kinds of knowledge are undocumentable. The challenge - at least for those charged with ensuring processes are documented - is deciding what is and what isn't documentable.

Re:Tacit Knowledge Is Dangerous by tikhonj on Tuesday December 12, 2023 @12:43PM (#38615589)
It's a definition. I suppose definitions are tautologies by definition though :)

And yeah, the real insight is not the definition but the fact that tacit knowledge is inevitable and important, and that trying to eliminate it will be actively counterproductive.

Re:Tacit Knowledge Is Dangerous by betenoire on Tuesday December 12, 2023 @12:38PM (#38615501)
I have a lot of habits because of lessons I've learned. There are 100 ways to do it, I chose 1. Documenting the 99 is unreasonable, but that's tacit knowledge, isn't it? I will document why I didn't choose the most obvious one, though.
Re:Tacit Knowledge Is Dangerous by peteradio on Tuesday December 12, 2023 @12:03PM (#38614908)
Was just arguing with my father whether the difficulty in transplanting TSMC was due to tacit knowledge or missing documentation. I argued that an automated process failing to run would inherently be missing documentation but I'm curious to see what kind of tacit information would be involved here.
Re:Tacit Knowledge Is Dangerous by vishnugupta on Tuesday December 12, 2023 @02:27PM (#38617079)
+1.

This[1] article that was on HN front a few months ago and I could only agree with it.

I've seen teams trying to micro-document their way to inefficiency. Forcing doers to document every darned small thing is the surest way to get them to lose interest. By now I've realised that regardless of documentation it takes around 6 months for a s/w engineer to be fully productive at a new company and start creating value.

[1] https://commoncog.com/tacit-knowledge-is-a-real-thing/

Re:Tacit Knowledge Is Dangerous by vakkermans on Wednesday December 13, 2023 @12:48AM (#38623204)
Well put!

Donald Schön’s work on this topic is really enlightening. It’s not just that there’s knowledge in the heads of people that can’t be linguistically expressed well, but also that expression of it requires interaction with a specific situation.

This is also represents a massive gap for AI systems to become actual in-the-world problems solvers.