News for hackers. Stuff that matters.
Re:How does Chrome decide what to highlight when you double-... by emilfihlman on Friday May 08, 2020 @03:01PM (#23118208)
From a very quick cursory look, Japanese seems to have some sort of commas and periods. Shouldn't it be just simple to adopt spaces, (and proper commas and periods and parentheses, which they actually use already) too?
Re:How does Chrome decide what to highlight when you double-... by 4bpp on Friday May 08, 2020 @03:25PM (#23118456)
Who would be both interested in and able to champion such a change, though? Spaced Japanese text would look at least as jarring to someone who is used to its present state as English text following the German capitalization pattern (all Nouns to be capitalised in all Contexts) would to an English speaker, and I doubt the present anglophone world could be persuaded to adopt the latter change even if it turned out to convey immeasurable advantages to computational processing of text.
Re:How does Chrome decide what to highlight when you double-... by corey_moncure on Friday May 08, 2020 @03:05PM (#23118243)
Sort of but then no one can agree on things like whether particles are part of the word or not. To the fluent reader, the kanji/kana switching breaks up the text enough to lex it. I'm non-native and actually reading all-kana is much more difficult for me than the usual mixture.

Many all-kana texts employ spaces. All-kana with no spaces is a nightmare.

Re:How does Chrome decide what to highlight when you double-... by LikeAnElephant on Friday May 08, 2020 @03:23PM (#23118434)
Agree with this, then you come across a more philosophical debate: should the very nature of written language change to adapt to the needs of technology, or the other way around?

On one hand, language has always been an amorphous thing and has changed throughout history. On the other could some changes change the very nature and heart of it? No one agrees on those trade-offs, and I argue likely never will.

Re:How does Chrome decide what to highlight when you double-... by Asooka on Friday May 08, 2020 @05:30PM (#23119708)
> should the very nature of written language change to adapt to the needs of technology

This has been always the case. I mean, think of how modern latin letter forms developed. Think back to the Roman Empire, when the letters were etched in stone or wax tablets, with only capitals (before the invention of minuscule), drawn with straight lines that are easy to chisel. Think of the later periods when many books were written by scribes using pen and ink, resulting in changes to letters so they could write entire words in one hand motion. Later still, we have the printing press and its demands that each letter be a discrete unit, doing away with the wavy flow of words. Today most people write using print letters simply because the majority of writing you would encounter is in print, so that's what's easiest to read. Those changes probably don't register to you as egregious as the one parent proposes, due to the fact that the person enforcing the change and the person developing the technology are one and the same - a native speaker modifying his own language to fit the tools at hand. Which I think brings us to a resolution - the native speakers of the language are the ones to decide how to change it to suit their everyday needs, including making it easier to produce and consume with the tools of the day.

Re:How does Chrome decide what to highlight when you double-... by thaumasiotes on Friday May 08, 2020 @08:19PM (#23120978)
> Think back to the Roman Empire, when the letters were etched in stone or wax tablets, with only capitals (before the invention of minuscule), drawn with straight lines that are easy to chisel.

To choose some random capital Roman letters, how about... SPQR? Those got inscribed all the time.

Roman letters don't really show any bias towards straight lines. Don't confuse the fact that we split the Roman letter V into two letters U/V with the idea that they didn't carve curved letters. Check out this awesome plaque from the year 90: https://www.timesofisrael.com/in-a-bronze-inscription-a-remn...

Re:How does Chrome decide what to highlight when you double-... by earthboundkid on Friday May 08, 2020 @10:49PM (#23121782)
Interestingly, it’s easier for me to read that bronze plaque from the first century than a typical manuscript from the fifteenth century, in part because in the early modern period, there was a purposeful revival of the Roman inscription style for writing. https://en.wikipedia.org/wiki/Roman_square_capitals
Re:How does Chrome decide what to highlight when you double-... by LikeAnElephant on Friday May 08, 2020 @06:10PM (#23120109)
> Which I think brings us to a resolution - the native speakers of the language are the ones to decide how to change it to suit their everyday needs, including making it easier to produce and consume with the tools of the day.

Agree with you here, it's well outside my rights as an English speaking American to have an opinion of any merit. However I would still struggle to call handing it over to native speakers a resolution. Many native speakers have incredibly strong feelings on both sides of the argument; and often for very good and valid reasons.

I'm glad the Unicode Consortium exists, because I am CERTAIN I don't want to be the decider or facilitator of these discussions. Way above my pay grade.

Re:How does Chrome decide what to highlight when you double-... by knolax on Friday May 08, 2020 @05:48PM (#23119885)
If the Japanese language needs to change, it won't be because some Western developer found it too hard to develop some obscure unused highlighting feature for it. The HN crowd's fetishistic need to change everything for the sake developer convenience really reflects poorly on programmers as a profession.
Re:How does Chrome decide what to highlight when you double-... by thaumasiotes on Friday May 08, 2020 @08:16PM (#23120948)
> To the fluent reader, the kanji/kana switching breaks up the text enough to lex it. I'm non-native and actually reading all-kana is much more difficult for me than the usual mixture.

Don't leap to conclusions about the benefit of breaking up the text. For example, reading Mandarin pinyin is much more difficult than reading characters, but neither of those involves a mixed script. (And heck, the pinyin might have word spacing! [1])

The reason is pretty obvious - characters contain a lot more than just phonetic information. That makes things harder on the writer, and easier on the reader.

[1] Pinyin produced for foreign learners usually has word spacing. Pinyin produced for Chinese children usually doesn't.

Re:How does Chrome decide what to highlight when you double-... by bluquark on Friday May 08, 2020 @04:31PM (#23119085)
The squarish glyph-shapes aren't a good fit for spaces. Scripts with spaces have unevenly shaped letters so that one can quickly scan a word by its length and pattern of ascenders/descenders. In Japanese spaces do not aid this type of scanning, and conversely the uneven densities of the glyphs allow for fast scanning without the aid of spaces.
Re:How does Chrome decide what to highlight when you double-... by nayuki on Friday May 08, 2020 @06:42PM (#23120340)
Spaces have been tried in Japanese. If you look at pure-kana (hiragana/katakana) texts aimed at grade schoolers and foreign language learners, there are spaces because without them there would be too much parsing ambiguity. Text with full kanji for adults do not use spaces, and this does not hurt comprehension at all.
Re:How does Chrome decide what to highlight when you double-... by thaumasiotes on Friday May 08, 2020 @10:24PM (#23121668)
> If you look at pure-kana (hiragana/katakana) texts aimed at grade schoolers and foreign language learners, there are spaces because without them there would be too much parsing ambiguity.

This cannot actually be true; the spoken sentences do not indicate word breaks, but grade schoolers (and toddlers) can parse them just fine.

Re:How does Chrome decide what to highlight when you double-... by syockit on Saturday May 09, 2020 @02:39PM (#23127281)
Because there are accents in spoken sentences. Now if you would include accent marks in the letters it might make it easier to parse. Sadly, as far as I know there are no standard accent marks for kana.
Re:How does Chrome decide what to highlight when you double-... by thaumasiotes on Sunday May 10, 2020 @03:17PM (#23135278)
While the prosodic contour of a sentence does help in parsing, there's a reason no writing system has ever taken notice of it. It's not necessary.

The most obvious way to see this would be to think about synthesized speech, which almost never uses natural prosody. Think of the voice of Stephen Hawking, or just a splicing of some prerecorded options. ("At the tone, the time will be / TWO / TWENTY / THREE / and / TEN / seconds.")

Re:How does Chrome decide what to highlight when you double-... by Freak_NL on Friday May 08, 2020 @03:24PM (#23118445)
You want to change a written language for the express purpose of enabling computers to be able to detect word boundaries easier?
Re:How does Chrome decide what to highlight when you double-... by bluquark on Friday May 08, 2020 @06:03PM (#23120042)
Note that Japanese and Chinese already changed to commonly use horizontal left-to-right text (in addition to vertical top-to-bottom/right-to-left text, which is still usual especially in "proper published typesetting") in large part because computers handled that much better for decades.
Re:How does Chrome decide what to highlight when you double-... by cooper12 on Friday May 08, 2020 @07:06PM (#23120496)
It's not so much that because they handled it better, but because that was how they handled it. Even to this day vertical text layout in CSS is primitive.

Early Japanese on computers also used half-width kana but now it's all properly fullwidth.

Don't mistake technical limitations for choice.

Re:How does Chrome decide what to highlight when you double-... by BigJono on Saturday May 09, 2020 @01:21AM (#23122517)
I wonder if there's any Japanese sites out there that fully use the traditional style? Text top to botttom, right to left, and with the horizontal axis unbound (to the left) instead of the vertical.
Re:How does Chrome decide what to highlight when you double-... by needle0 on Saturday May 09, 2020 @02:15AM (#23122703)
I'm sure there are some extremely design-heavy sites that do it, but by then you would be fighting the DOM/CSS pretty hard, as default behaviors for stuff like underline position and 縦中横 (short bursts of horiz text within vertical text, for things like two-digit numbers) seem to be sketchy at best, and many things still don't seem to be uniform across browsers. UX would be affected as well, as things like text selection or right-clicking would feel quite awkward as it is so exceedingly rare. While us Japanese are fully capable of reading both horizontally+LtR and vertically+RtL, it's not in our expectations for the latter to appear in online web text.
Re:How does Chrome decide what to highlight when you double-... by Asooka on Friday May 08, 2020 @04:34PM (#23119123)
It's not entirely unprecedented. Modern cyrillic shapes are in part influenced by the printing press - when it was being imported in Russia, they didn't want to mill an entire new set of characters, so they repurposed the latin ones that look like cyrillic characters and only added the ones that were missing. Of course, parent's suggestion will never pass, as it will require everyone everywhere to start using spaces, which is more trouble than it's worth to native language users.
Re:How does Chrome decide what to highlight when you double-... by anonymfus on Saturday May 09, 2020 @12:31AM (#23122344)
Where did you get that idea? Peter I created Civil Script a few centuries after adoption of printing press in Russia.
Re:How does Chrome decide what to highlight when you double-... by emilfihlman on Friday May 08, 2020 @03:36PM (#23118569)
It's just lighthearted pondering on the issue. Written language evolves, or is that only a standard applied to $YOUR_LANGUAGE when defending people not learning it?

I think having spaces is useful, too, for learning speed and expression.

Re:How does Chrome decide what to highlight when you double-... by rafi_kamal on Friday May 08, 2020 @03:51PM (#23118726)
Similar argument also applies to English. English isn't phonetic which makes it hard to pronounce correctly unless you are learning from a native speaker. But I don't see written English to evolve in a way that makes it easier to pronounce for new learners.
Re:How does Chrome decide what to highlight when you double-... by mring33621 on Friday May 08, 2020 @04:59PM (#23119393)
I'm a life-long English speaker and am 100% OK with changing the language to make it easier to learn.
Re:How does Chrome decide what to highlight when you double-... by zeroimpl on Friday May 08, 2020 @06:00PM (#23120022)
Let’s make phase 1 be the unification of American and British spelling. That should be easy enough right?
Re:How does Chrome decide what to highlight when you double-... by Piskvorrr on Saturday May 09, 2020 @07:39AM (#23123891)
It's not like they couldn't learn English. Oh, while we're at it, let's also force English into ASCII. And let's make it Lojban for good measure.