Re:Please grow your buffers exponentially
by zimpenfish on Thursday November 06, 2014 @06:31AM
(#8566579)
I wonder why those haven't got traction with things like Mozilla though. Presumably -someone- would at least have looked at them if they're that big a win?
Re:Please grow your buffers exponentially
by Roboprog on Tuesday November 04, 2014 @05:59PM
(#8559591)
I meant "DOM" as in the general "tree in memory" data structure. You did find an implementation that uses about 1/3 the memory of some of the piggier ones, though.
Re:Please grow your buffers exponentially
by throwawayaway on Friday November 07, 2014 @04:54AM
(#8571824)
closer to 1/5th.
also, in actual use -> those are peak values, so while libxml will hog the memory until the DOM is freed, the streaming style parsers hold on to the smaller amount of memory for a shorter time.
Re:Please grow your buffers exponentially
by Roboprog on Thursday November 13, 2014 @10:47AM
(#8602098)
In the problem above, I did try using the SAX parser that the WebLogic-JVM "factory factory factory" returned, but the element text was about 2 MB, and it wanted to return it in pieces by repeatedly firing the event handler.
Manually finding the index of the open/close elements and doing a substring to get the element text was SO incredibly much faster and smaller, albeit something that only worked for a VERY specific situation.
http://pugixml.org/benchmark/
specifically: http://pugixml.files.wordpress.com/2010/10/dom-memory-compar...