News for hackers. Stuff that matters.
Re:URL Parsing in WebKit by thaumaturgy on Friday December 02, 2016 @04:55PM (#13092674)
This is a problem that's near and dear to my heart, and more progress on standardizing URL parsing would be lovely. I have a crawler and a data miner that both rely on URL parsing, and it's kind of a pain. There are about a hundred tests that the code needs to pass with each revision, and it's only a fraction of the tests that are needed and there are still edge cases found in the wild.

For instance, telling the difference between a web uri and a mailto uri without the benefit of a scheme at the beginning of the uri is total guesswork.

The parser's current approach is to return parsed URIs along with a confidence percentage and the application logic then tries to make some additional guesses based on context.

URI parsing is not my favorite thing.

There are no comments on this comment yet.