News for hackers. Stuff that matters.
Re:Streaming UTF-8 (with node.js) by felixge on Tuesday May 18, 2010 @10:33AM (#1357550)
Don't use this, it's broken. Any % sign in your text will screw things. 3-4 byte characters are not handled by it at all.
Re:Streaming UTF-8 (with node.js) by axod on Tuesday May 18, 2010 @10:40AM (#1357577)
Care to elaborate?

% signs are handled fine - they get encoded into %25 which then gets shortened to a single 'x' character - thus counted as a single byte.

Similarly, for example € gets encoded to "%E2%82%AC" which then gets correctly counted as 3 bytes.

I'm not quite sure what value of 'broken' you're thinking of? Did you try this and find it didn't work in some particular circumstance?

Re:Streaming UTF-8 (with node.js) by felixge on Tuesday May 18, 2010 @10:47AM (#1357606)
I didn't know % gets encoded. So you're right, your code does work : )
Re:Streaming UTF-8 (with node.js) by axod on Tuesday May 18, 2010 @11:46AM (#1357858)
FWIW, Checking code or reading API docs is pretty useful :P

firebug works pretty well for testing out code snippets.

The internet is full of enough incorrect information regarding javascript as it is, and if you think about it, % has to be encoded, otherwise anything containing a % would be decoded wrongly ;)