News for hackers. Stuff that matters.
Re:Parsing: the solved problem that isn't by _tef on Tuesday March 15, 2011 @10:31AM (#2327593)
and while i'm here - the original earley paper is full of bugs.for a modern treatment you may find aycock & horspool's work on 'practical earley parsing' interesting, as well as the work on the Marpa Parser in perl.

to me: the earley parser and the packrat parser are similar in nature - they are both chart parsers. one is depth first, one is breadth first.

my question: can you engineer an earley parser that supports ordered choice and exploits this to avoid broadening the search too early -- ie can earley parsers support PEGs

I think it is possible and when i'm not drowning in my startup work i'd like to take a longer look at it.

fwiw my terrible attempts at an earley recognizer are here http://pastie.org/private/uezi1mxiur8dymdbh2scw

i've tried to use some ideas from the aycock and the aretz variants of the earley parser - avoiding lists of earley items at a character - instead storing the reductions/completions seperately from the scanning items, and using a driver rather than the predictor/completor loop (still need to add nullable support...)

Re:Parsing: the solved problem that isn't by ltratt on Tuesday March 15, 2011 @12:09PM (#2328092)
I'm not sure the Earley paper "is full of bugs" - to the best of my knowledge, it has only one bug (albeit a biggy), which is in its description of how to create a parse tree.
Re:Parsing: the solved problem that isn't by _tef on Tuesday March 15, 2011 @12:25PM (#2328161)
it isn't cubic time either iirc
Re:Parsing: the solved problem that isn't by ltratt on Tuesday March 15, 2011 @12:33PM (#2328199)
Yes, that's part of the same bug, as I understand it anyway (to be clear: I'm not sure that anyone's claiming that there are problems with Earley's recogniser, which is really the core of his paper). Scott's "SPPF-Style Parsing From Earley Recognisers" gives an overview of the bug and its implications.
Re:Parsing: the solved problem that isn't by _tef on Tuesday March 15, 2011 @12:49PM (#2328278)
I can't remember off hand if it dealt with nullable terms or hidden left recursion properly either.

don't get me wrong: I like the earley parser :-) I just think the original paper has some omissions and the treatment of earley parsing in 'parsing techniques 2nd ed' is thorough and includes substantial references and explanations of further work.