Re:The Sad Story Of The Unicode Snowman
by JoachimSchipper on Friday December 24, 2010 @02:59AM
(#2036836)
That'd be fine for Americans (or other people using ASCII) faced with a Russian а, but how about a Russian faced with an ASCII a? You could hardly flag every use of ASCII, and creating a table of which characters go together seems a a lot of work (and it would be hard to do properly).
Would it really be a lot of work? I'd imagine the effort expended towards security in general exceeds what you're proposing.
EDIT: As I understand it, Cyrillic languages use code page 866 as an extension to ASCII http://en.wikipedia.org/wiki/Code_page_866. Is this correct?
Re:The Sad Story Of The Unicode Snowman
by JoachimSchipper on Friday December 24, 2010 @09:05AM
(#2037254)
I'm sure that something would be extremely painful. Some sort-of-independent tribe/people that uses one or two letters that are "really part" of another language. In short, politics.
To the best of my knowledge, Cyrillic languages don't use the Roman script (except where letters appear to be similar). The ASCII subset of codepage 866 is for "cd C:\", not for Cyrillic.
I agree - it could be tricky politically, but I'm not sure if the alternative of representing the characters via punycode conversion is more culturally supportive / sympathetic?
Re:The Sad Story Of The Unicode Snowman
by kapranoff on Saturday December 25, 2010 @08:09AM
(#2038892)
CP866 is a very old standard, it was used in pre-Windows times. There are at least 3 more standards to encode cyrillics in 8 bits. Today, most Cyrillic letters on the web are encoded in either UTF-8 or CP1251.
All of them define the whole alphabete, though, so even the letters that look similar to some latin letters are always encoded differently.
That way the characters are respected, but the user is alerted if a very similar (non-ASCII) code has been used to dupe a user.