Re:Tom Scott: After ten years, it's time to stop making vide...
by asveikau on Tuesday January 02, 2024 @02:34PM
(#38845956)
I disagree, if you are correctly handling Unicode you already are going through some "decode" function which parses a 32 bit quantity from utf-8 or utf-16. From there you need to handle multiple codepoints together sometimes, like for non-composed diacritics, han unification, and some emojis. This is complex regardless of whether or not you use utf-8 or utf-16, in fact I'd say it's more difficult to handle than those.
[ Parent
| on HN ]
Re:Tom Scott: After ten years, it's time to stop making vide...
by Dylan16807 on Wednesday January 03, 2024 @03:31AM
(#38851930)
We're not talking about fully correctly handling Unicode, we're talking about teaching someone the basics of an encoding. Context is critical here.
Re:Tom Scott: After ten years, it's time to stop making vide...
by asveikau on Wednesday January 03, 2024 @12:35PM
(#38856903)
If you want to teach someone how an encoding works, why would you not tell them that a single symbol can take multiple codepoints?
It seems like you're advocating people learning incorrect information and forming their impressions of it on falsehood. Which is probably why people think utf-32 frees you from variable-length encoding.
Re:Tom Scott: After ten years, it's time to stop making vide...
by Dylan16807 on Wednesday January 03, 2024 @12:39PM
(#38856975)
You should tell them, yes. And talk about it more at some point. But you don't have to go into much detail when today's lesson is specifically teaching UTF-8 or UTF-32. I don't know about you, but I think I could teach the latter about ten times faster.
As part of a comprehensive dive into Unicode it's a minor part, but for teaching an encoding it's a significant difference.
Re:Tom Scott: After ten years, it's time to stop making vide...
by asveikau on Wednesday January 03, 2024 @01:02PM
(#38857306)
> I think I could teach the latter about ten times faster.
I've lectured computer science at the university level, and I think you could introduce all this information to a CS undergrad pretty coherently and design a lab or small assignment on it no problem. Maybe you could ask them to parse some emojis that require multiple 32-bit codepoints.
Re:Tom Scott: After ten years, it's time to stop making vide...
by Dylan16807 on Wednesday January 03, 2024 @02:22PM
(#38858524)
That sounds entirely reasonable, but you have to deal with a lot less engagement when you're teaching via blog post or similar.