Text normalization in Go

Re:Text normalization in Go by hmmdar on Wednesday November 27, 2013 @01:15AM (#6806746)

Looks like this issue is pervasive in other languages as well. Out of curiosity ran the same test in Javascript and received the same result.

  s = "We went to eat at multiple cafe\u0301"
  "We went to eat at multiple café"
  s.replace('cafe', 'cafes');
  "We went to eat at multiple cafeś"

Interesting thing is when the text is copy-pasted backspacing first deletes the accent. At least in chrome.

[ Parent | on HN ]

Re:Text normalization in Go by lstamour on Wednesday November 27, 2013 @02:24AM (#6806953)

FYI:

Node.js - https://github.com/walling/unorm YMMV, but looks good.

It can also serve as a polyfill for the eventual http://people.mozilla.org/~jorendorff/es6-draft.html#sec-str...

[ Parent | on HN ]