News for hackers. Stuff that matters.
Re:Please grow your buffers exponentially by throwawayaway on Tuesday November 04, 2014 @01:06PM (#8558007)
nah, the guy is right there's better tech since 2010, just nobody has bothered to swap out the old style DOM stuff for pugixml/rapidxml/vtdxml.

http://pugixml.org/benchmark/

specifically: http://pugixml.files.wordpress.com/2010/10/dom-memory-compar...

Re:Please grow your buffers exponentially by zimpenfish on Thursday November 06, 2014 @06:31AM (#8566579)
I wonder why those haven't got traction with things like Mozilla though. Presumably -someone- would at least have looked at them if they're that big a win?
Re:Please grow your buffers exponentially by Roboprog on Tuesday November 04, 2014 @05:59PM (#8559591)
I meant "DOM" as in the general "tree in memory" data structure. You did find an implementation that uses about 1/3 the memory of some of the piggier ones, though.
Re:Please grow your buffers exponentially by throwawayaway on Friday November 07, 2014 @04:54AM (#8571824)
closer to 1/5th.

also, in actual use -> those are peak values, so while libxml will hog the memory until the DOM is freed, the streaming style parsers hold on to the smaller amount of memory for a shorter time.

Re:Please grow your buffers exponentially by Roboprog on Thursday November 13, 2014 @10:47AM (#8602098)
In the problem above, I did try using the SAX parser that the WebLogic-JVM "factory factory factory" returned, but the element text was about 2 MB, and it wanted to return it in pieces by repeatedly firing the event handler.

Manually finding the index of the open/close elements and doing a substring to get the element text was SO incredibly much faster and smaller, albeit something that only worked for a VERY specific situation.