News for hackers. Stuff that matters.
Re:Hnweekly: weekly top stories from Hacker News by xtimesninety on Friday December 26, 2008 @09:41AM (#410174)
I might have problems with unicode in PHP (I really don't know much here yet) so I opted to remove them (for now) using regex.

btw I'm using http://simplehtmldom.sourceforge.net/ to scrape/parse which is great, it let's you use jquery style selectors on html.

Re:Hnweekly: weekly top stories from Hacker News by russell on Friday December 26, 2008 @01:10PM (#410308)
ö doesn't need Unicode. It's ISO-Latin-1 (ISO-8859-1). An update is ISO-8859-15. Latin-1 is an 8 bit character set including ASCII, covering the Western European languages. I don't know PHP, but it could be the default or a simple character set option.
Re:Hnweekly: weekly top stories from Hacker News by scorxn on Friday December 26, 2008 @02:11PM (#410344)
Re:Hnweekly: weekly top stories from Hacker News by delano on Friday December 26, 2008 @10:04AM (#410185)
In that case, it should replace ö with o, etc.
Re:Hnweekly: weekly top stories from Hacker News by rtw on Friday December 26, 2008 @11:54AM (#410255)
I have a screenscraping thing in place that targets an ASCII only environment (LambdaMOO mud). Manually replacing unicode stuff like this has been a pain in the butt. Luckily that was all just for fun and didn't need to be perfect.

Is there a good library out there (in any language) that does good unicode --> ASCII substitutions for major languages?

Re:Hnweekly: weekly top stories from Hacker News by xtimesninety on Friday December 26, 2008 @12:05PM (#410265)
I once used latin1_to_ascii (The Unicode Hammer) in python: (works great) http://code.activestate.com/recipes/251871/
Re:Hnweekly: weekly top stories from Hacker News by rtw on Friday December 26, 2008 @12:33PM (#410286)
Awesome thanks. Two coincidences: this fun mud thing is in Python (works via RPC)... and the entry method name is "hammer," heh.