News for hackers. Stuff that matters.
Re:Ithkuil, the Most Complicated Language by fsiefken on Tuesday May 23, 2023 @09:41AM (#36044134)
Like typing with a modified Dvorak like keyboard layout I imagine it would be more comfortable to think, read and speak in Ithkuil. It took me three months to switch from Qwerty to a Dvorak-like 20 years ago. I still can type both, even though it feels significantly less comfortable to type in Qwerty, I guess I’m spoiled. How long would it take for me to learn Ithkuil? I don’t have to speak it as there is no one understanding it (except other dorks on the internet), so it’s better to learn to read and write my personal notes in Ithkuil. This means I should also have a dvorak like Ithkuil TNIL keyboard layout. Is there such a thing? Ideally I also want to converse with a LLM trained on Ithkuil texts. As there are very few TNIL (the latest version) texts I wonder if somekind of translator can be build that can translate a large relevant body of English texts for me into Ithkuil.
Re:Ithkuil, the Most Complicated Language by p-e-w on Tuesday May 23, 2023 @10:22AM (#36044764)
> I imagine it would be more comfortable to think, read and speak in Ithkuil

There are some cognitive scientists who believe that the ability to use language is built into the human brain, and (natural) language acquisition basically involves just setting the "parameters" of that built-in system.

If that is true, there's no reason to assume that a highly constructed language like Ithkuil can ever be as comfortable to use as a natural language that has evolved to be compatible with our brain's language mechanism.

Language has been with humans for a very long time (up to 100k years according to some hypotheses); it's not just another tool like a keyboard layout, which I believe might be the main reason why all conlangs from the past 100 years have failed to reach widespread adoption, despite their numerous claimed advantages. The assumption that humans are able to intellectually construct a language that is usable as a human language in the same way natural languages are lacks any evidence.

Re:Ithkuil, the Most Complicated Language by meepmorp on Tuesday May 23, 2023 @10:35AM (#36044924)
> There are some cognitive scientists who believe that the ability to use language is built into the human brain, and (natural) language acquisition basically involves just setting the "parameters" of that built-in system.

This, by the way, is essentially what Chomsky means by “universal grammar,” in his writing - the inborn language capability and its fundamental structure. His theoretical framework even went through a period where it was called Principles and Parameters.

Re:Ithkuil, the Most Complicated Language by kortex on Tuesday May 23, 2023 @11:03AM (#36045325)
As someone who tinkers with conlangs as a hobby and has been working on a similarly highly-engineered language not unlike ithkuil in features, this is one of the main things I struggle with.

Actual natural language is very fluid. Spelling, pronunciation, grammar, all shift around, and for all manner of reasons. But the main one is efficiency. Humans are always subconsciously trying to cram as much information into as little time as possible, while preserving enough intent. This means extra redundant information whittles away, but there has to be enough redundancy for error correction.

With these highly compressed languages, the problem becomes that a slight mispronounciation or misspelling can totally mess with the meaning in ways which lead to confusion. There are just too many phonemic sounds (a given sound difference is phonemic if the distinction matters, eg in English, p and p' (aspiration) is non-phonemic, but in Korean it is)

When you actually analyze languages for their "baud rate" so to speak, languages with more symbol diversity (English) have less phonemes per unit time, while languages with less symbol diversity (Italian) have more phonemes, but the overall entropy per unit time works out pretty much the same. (I can't find my exact source right now, but if you poke around keywords like spoken language entropy rate, there's quite a bunch).

Basically when you have machine code as a language, you pretty much need machine brain to process it.

Edit: here's a start of some sources:

https://seantrott.github.io/information/

Which mostly cites https://www.science.org/doi/10.1126/sciadv.aaw2594

Re:Ithkuil, the Most Complicated Language by zubairshaik on Tuesday May 23, 2023 @01:56PM (#36048174)
Where would you say Esperanto sits on the "natural" scale, since it's design goal is to be easy to learn and use as opposed to being highly compressed? As I wouldn't say its "[s]pelling, pronunciation, grammar, all shift around, and for all manner of reasons".
Re:Ithkuil, the Most Complicated Language by TRiG_Ireland on Tuesday May 23, 2023 @05:20PM (#36050995)
Many children have acquired Esperanto naturally, as a first language, and that does seem to work without any problems.
Re:Ithkuil, the Most Complicated Language by rerdavies on Tuesday May 23, 2023 @05:51PM (#36051311)
That seems like a very dangerous experiment to conduct on a child.
Re:Ithkuil, the Most Complicated Language by pseudalopex on Wednesday May 24, 2023 @03:10PM (#36062683)
How? Did you think they meant only language?
Re:Ithkuil, the Most Complicated Language by Garlef on Tuesday May 23, 2023 @11:10AM (#36045417)
> has evolved to be compatible with our brain's language mechanism.

Under the hypothesis that there actually is such a "language mechanism": There would be a host of other mechanisms a language needs to compatible with - such as spoken and written word - that might have contributed adversarial constraints along the way (from the perspective of optimal adjustment of a language with respect to this mechanism).

Re:Ithkuil, the Most Complicated Language by meepmorp on Tuesday May 23, 2023 @11:48AM (#36046061)
There’s a whole strand of work in phonology (and other linguistics areas) called optimality theory, and the basic idea is that what you see in surface-level language is the the result of solving a competing constraints problem.
Re:Ithkuil, the Most Complicated Language by tikhonj on Tuesday May 23, 2023 @12:09PM (#36046348)
> which I believe might be the main reason why all conlangs from the past 100 years have failed to reach widespread adoption

Given how much people hate learning much more basic things—new programming languages, new operating systems, new tools—it seems hard to come to any conclusion about conlangs based on popularity! Languages are hard to learn, have immense cultural significance and are dominated by network effects. The potential advantages of a constructed language are, at best, illegible. What would push anybody to learn a brand new language well enough to actually use it?

Whether or not a language becomes popular tells us little to nothing about the language itself.

Re:Ithkuil, the Most Complicated Language by Konohamaru on Tuesday May 23, 2023 @01:53PM (#36048137)
Generative grammar is extremely nativist. The truth is, people will learn anything society forces them to learn. In Piraha society nobody is forced to learn recursion and consequently nobody thinks recursively or in numbers.

The global languages of A.D. 2023 (English, French, etc...) are probably stuck in a similar "Chomsky tarpit" as Piraha, but because we're so globalized and together nobody is brave enough to look out of this tarpit.

I am constructing a conlang codename LXX (because it has 70 phonemes, 15 vowels and 55 consonants, but they were carefully chosen to be learnable to pronounce unlike Ithkuil) for the purpose of getting at least one human society out of this tarpit.

Re:Ithkuil, the Most Complicated Language by fsiefken on Tuesday May 23, 2023 @03:39PM (#36049770)
The new 2023 ithkuil addresses this with only 32 consonants and 9 vowels
Re:Ithkuil, the Most Complicated Language by ibejoeb on Tuesday May 23, 2023 @09:55AM (#36044334)
It seems more like, if you do manage to internalize some of the language, that you might be able to augment your thinking language rather than replace it. For the things that are not readily expressible in your native language, Ithkuil could serve to characterize those thoughts. I do wonder how robust recall would be, though, in terms of time and fidelity.
Re:Ithkuil, the Most Complicated Language by lordnacho on Tuesday May 23, 2023 @10:04AM (#36044475)
What are some interesting examples of things I could express in Ithkuil?

Suppose for an English speaker. I get that it will be weird to write an answer in English. Could be really interesting if someone has a good example though.

Re:Ithkuil, the Most Complicated Language by thrtythreeforty on Tuesday May 23, 2023 @10:30AM (#36044865)
One of my favorite examples:

Aistlaţervièllîmļ - skipping an opportunity because it's not ideal, despite the likelihood that an ideal instance will never come

Re:Ithkuil, the Most Complicated Language by p-e-w on Tuesday May 23, 2023 @10:38AM (#36044961)
But that concept can also be expressed in English – which you just did.

If you simply run the English description you gave through a Huffman coder, you should get a compressed version that is the same length or even shorter than the Ithkuil word (English usually compresses to about 1 bit per character).

Is Ithkuil anything more than a compressed encoding of English? Can it express any concept that English is fundamentally incapable of expressing?

Re:Ithkuil, the Most Complicated Language by adastra22 on Tuesday May 23, 2023 @10:46AM (#36045084)
No, because English is the linguistic equivalent of Turing complete. There is no concept you can’t express (if verbosely) in English.

But the weak form of Sapir-Worf is that verbosity and grammar matters, that we tend to think in shortest forms, and that if we had a mother tongue or native-level language that was expressive, precise, and minimally ambiguous, that would be reflected in the clarity of our thinking.

Re:Ithkuil, the Most Complicated Language by ajuc on Tuesday May 23, 2023 @11:04AM (#36045349)
One example where natural language is clearly suboptimal is math. Most people can do simple transformations on equations with small polynomials in memory. But that's thinking in formulas.

When you try to do it in plain English it becomes very hard.

Re:Ithkuil, the Most Complicated Language by adastra22 on Tuesday May 23, 2023 @12:56PM (#36047142)
I agree. Wouldn’t it be interesting then to see what we could accomplish if we unlocked similar formalisms for critical thinking and daily life?

I’m not a fan of Ithkuil actually, as I think it takes it too far. But I do wonder how much clearer our thinking would be if we had a logical / rational language as our mother tongue.

Re:Ithkuil, the Most Complicated Language by olddustytrail on Tuesday May 23, 2023 @04:33PM (#36050481)
It's suboptimal but not impossible. As a child I won a prize (not first place, just a mention) in a national mathematical competition despite the fact no-one had taught me algebra yet. The judges found my reasoning "interesting" and I got the right answers to the puzzles.

Of course when, a couple of years later, I was taught algebra, I was wondering why I hadn't been told before!

Re:Ithkuil, the Most Complicated Language by p-e-w on Tuesday May 23, 2023 @10:48AM (#36045110)
> English is the linguistic equivalent of Turing complete

Proof?

Re:Ithkuil, the Most Complicated Language by kortex on Tuesday May 23, 2023 @11:10AM (#36045413)
English (or any human language with the possible exception of Pirahã) is not a formal grammar, but if it was, it would behave like a recursively enumerable one, at the top of the Chomsky hierarchy. Given enough time and enough text, you can express anything computable.

Think about it this way, I give you instructions in english, and you have to follow them:

    You are acting as a turing machine. Your symbols are s1, s2, ..., sn. Here are your processing rules: ... Here is your tape: ... Begin!
You could follow that process to the letter, given enough time, focus, and tape (insert xkcd reference about rocks in the desert).
Re:Ithkuil, the Most Complicated Language by p-e-w on Tuesday May 23, 2023 @11:25AM (#36045663)
This makes no sense to me. What does computability have to do with semantic expressiveness? You've demonstrated that English can generate every sequence of tokens, not that it can express every concept.
Re:Ithkuil, the Most Complicated Language by kortex on Tuesday May 23, 2023 @11:34AM (#36045822)
If a concept can be expressed as a sequence of tokens, then bam, we're done.

If a concept can't be expressed as a sequence of tokens, then it doesn't really matter, because no language can, since some concepts exist which are not computable, and all languages have the same drawback.

Either way, "English is the linguistic equivalent of Turing complete" is valid, since it is at the top of the hierarchy, and as powerful as any other language (eg everything Ithkuil can express, so can English).

Re:Ithkuil, the Most Complicated Language by p-e-w on Tuesday May 23, 2023 @11:51AM (#36046102)
> everything Ithkuil can express, so can English

Imagine there is a concept that no language can express.

Now Ithkuil introduces a new word that is defined as that concept.

But English (and all other languages) still cannot express that concept. So the idea that all/most languages are expressively equivalent appears to be false.

The Chomsky hierarchy is about grammatical expressiveness, not about semantic expressiveness. I see no reason to believe that all languages have the same semantic expressiveness, which is what I understood the above claim to mean.

Re:Ithkuil, the Most Complicated Language by variaga on Tuesday May 23, 2023 @01:15PM (#36047470)
>Now Ithkuil introduces a new word that is defined as that concept.

You are assuming the consequent. How exactly did Ithkuil 'define' a new word as that concept if the concept can't be expressed in Ithkuil ("any language")?

Even assuming you could do such a thing, why couldn't every other language define a word to mean that concept in the same way? Why wouldn't English - in particular - just make the new Ithkuil word also an English word?

Re:Ithkuil, the Most Complicated Language by adastra22 on Tuesday May 23, 2023 @01:41PM (#36047894)
That's what the original form of the Sapir-Worf hypothesis was about. IIRC they were studying indigenous languages which lacked a word for numerical concepts. E.g. there's a bunch of languages/cultures which allegedly only have a words for "one", "two", and "many." Do people in these cultures not have a concept of "three"? Early studies suggested that might be the case. Sapir and Worf wondered if perhaps these people would be incapable of understanding the notion of "three", as appeared to be the case, because they lacked the word for it.

Turns out the results didn't replicate though, for a variety of reasons. Even in cases where the source languages didn't have higher numbers (which was much less common than originally thought), the speakers of course had a way of referencing numbers. In at least one case I believe the language had no unique number words at all, and what the linguist had thought was the word for "one" was in fact "alone", and the word for two was "couple" (as in "married couple"), and so on. They did indeed have such figurative words for larger numbers, and a place system for speaking of even larger amounts (e.g. a dozen-dozen people).

The Sapir-Worf hypothesis also falls flat in another way: if we cannot conceive of a concept without a word for it, then how did language develop? Clearly there must be a way to learn a new concept, think about it, and then be the first to coin a new word for it.

The original, strong form of the Sapir-Worf hypothesis is largely discredited today. But not the weak form, which is expressed thusly: "The language we speak influence the ways in which we think." This does seem to be largely true.

There are studies but I'd rather point to some anecdotal examples that illustrate more why I find this interesting. Learning math, critical thinking, and engineering has enabled me to reason much more precisely about things than I did as a teenager. Having been through the community college system, I also have observed the great difficulty a lot of people less interested in scientific thinking have had in adopting various concepts in critical thinking. Like the difference between conditional implication (if) and biconditional statements (if and only if). In everyday English we often say "if", when in fact "if and only if" is the more correct statement. Or we say "A or B" when we mean "A or B, but not both" (exclusive-or).

In English these longer forms are cumbersome, and the other alternative, "if" or "or", are in fact abbreviations of the longer forms "if and only if" and "A or B, but not both". So we decide that the shorter forms can mean either form, and resort to cumbersome language when clarity is required. If I tell you "I wear a hat if it is sunny" and you see me come indoors with my hat on, can you infer that it is sunny outside? No, because I said nothing about what I do when it is cloudy, not sunny outside. Maybe I wear a hat then too. If I had said "I wear a hat if and only if it is sunny" it'd be a different story. But that doesn't feel right because we know that people often shorten "if and only if" to just "if", and so we might feel justified in assuming the speaker meant they wear a hat if and only if it is sunny outside.

But in Lojban, Ithkuil, and Toaq, each truth table possibility is assigned a unique, approximately equal-length and unambiguous word/morpheme to represent it. It's like we coined the word "ba" to mean "if and only if." So the two statements become "I wear a hat if it is sunny" and "I wear a hat ba it is sunny". They are equal length so why wouldn't I pick the one that I mean? Then "if" can go back to meaning "if" exclusively, and never "if and only if".

You might say that people aren't used to making such finely tuned logical distinctions, but that sounds a lot like what a Chinese person might say about conjugating for tense and number in English, or for gender in most other Indo-European languages. Why does a verb change form based on the number of thing, its gender, or whether it happened in the past or future, or was an ongoing activity? And how can you possibly keep this all straight while speaking at fluent speeds? But in fact native speakers of English have no trouble doing so.

Maybe, just maybe, if we all spoke Lojban or Toaq or Ithkuil or whatever, these fine logical and critical thinking distinctions will be as natural to us as the verb changes in "he went", "she goes", or "I will go" are, which any native speaker gets correct without even consciously having to think about it, yet nevertheless confounds learners of English.

Re:Ithkuil, the Most Complicated Language by TRiG_Ireland on Tuesday May 23, 2023 @05:28PM (#36051071)
Even the weak Sapir-Worf hypothesis is quite tricky to test in practice. It's likely true, but quite hard to prove. Guy Deutscher's excellent book Through the Language Glass documents much of the work that's been done in that area. Mostly, what's amenable to testing is colour perception and absolute direction, more than anything else.
Re:Ithkuil, the Most Complicated Language by adastra22 on Tuesday May 23, 2023 @01:02PM (#36047251)
> since some concepts exist which are not computable

Is this true?

Re:Ithkuil, the Most Complicated Language by adastra22 on Tuesday May 23, 2023 @01:01PM (#36047235)
That’s the Chuch-Turing thesis, combined with computational semantics. Computational semantics gives us formal logical statements for anything you might want to say, the Church-Turing thesis states that computational processes are equivalent to these logical formalisms, and you’ve accepted that any computational process can be represented in English (if verbosely).

The only exception would be things not express able on our semantic models which you might want to say. No one has ever been able to offer up an example of something that couldn’t be represented in a logical formalism, so…

Re:Ithkuil, the Most Complicated Language by ted_dunning on Tuesday May 23, 2023 @04:36PM (#36050516)
Except that you missed that the original comment was using computational completeness metaphorically, not literally.
Re:Ithkuil, the Most Complicated Language by adastra22 on Tuesday May 23, 2023 @07:58PM (#36052331)
I'm the original comment author ;)
Re:Ithkuil, the Most Complicated Language by adastra22 on Tuesday May 23, 2023 @10:50AM (#36045139)
You are asking for a proof of a negative, which can’t be proven. Nevertheless I offer the entire field of computational semantics, which has yet to generate a counter-example.
Re:Ithkuil, the Most Complicated Language by mcguire on Tuesday May 23, 2023 @02:27PM (#36048680)
By construction. Assume language L has concept C expressed by term T, while English does not have a simple term for C. Further, assume that English speakers have a frequent need to express C.

English will simply absorb T and trundle off like the demented lunatic it is. Examples include remuda, schadenfreude, and obi, all of which are copacetic English words after a remarkably short period of time.

Re:Ithkuil, the Most Complicated Language by random_upvoter on Tuesday May 23, 2023 @12:33PM (#36046709)
Does Ithkuil have any provisions to express power dynamics between speaker and listener, say politeness levels? For instance all languages that I know have constructions to soften up requests, or make statements less assertive.
Re:Ithkuil, the Most Complicated Language by pohl on Tuesday May 23, 2023 @10:23AM (#36044768)
Just yesterday I was pondering Ithkuil, the Sapir–Whorf Hypothesis, and LLMs.
Re:Ithkuil, the Most Complicated Language by kortex on Tuesday May 23, 2023 @11:46AM (#36046027)
Fluency in Ithkuil is probably impossible practically speaking. John Quijada himself doesn't consider himself fluent.

I actually think LLMs trained on conlangs is a super cool idea, but you'd need a huge corpus to do that. Kind of a bootstrapping problem.

Re:Ithkuil, the Most Complicated Language by fsiefken on Tuesday May 23, 2023 @03:48PM (#36049920)
The new 2023 Ithkuil addresses part of the learnability. Yes I need a large corpus, that’s why I thought maybe some kind of rough automatic translator can be built to aid in getting this body and the LLM trained
Re:Ithkuil, the Most Complicated Language by ted_dunning on Tuesday May 23, 2023 @04:41PM (#36050572)
But that will only train the LLM on Ithkuil expressions that came from English (or whatever you translated from). The interesting point is the expressivity beyond that.