Re:Records: Python library for making raw SQL queries to Pos...
by tcoder on Sunday February 07, 2016 @03:15PM
(#11054590)
Namedtuple CPU-speed performance for some common operations is TERRIBLE compared to dictionaries, at least on 2.7. Orders of magnitude difference. So bad that it really matters. It's shocking how bad the implementors got this.
[ Parent
| on HN ]
Re:Records: Python library for making raw SQL queries to Pos...
by pyre on Sunday February 07, 2016 @03:27PM
(#11054645)
namedtuple is just a thin wrapper around tuple. It literally constructs a class definition that sub-classes tuple as a string and then executes it. You can see the string template that it uses here[1]. If you're interested in something like namedtuple there are other[2] things[3] you can use depending on your use-case.
[1] https://github.com/python/cpython/blob/master/Lib/collection...
Re:Records: Python library for making raw SQL queries to Pos...
by Redoubts on Sunday February 07, 2016 @09:21PM
(#11056066)
It's really weird that immutable tuples take a performance hit, compared to mutable lists (almost 50% on access!?!).
Re:Records: Python library for making raw SQL queries to Pos...
by pyre on Monday February 08, 2016 @01:02AM
(#11056570)
That's because Python 2 has a special case for lists[1]. This does not exist in Python 3[2] (and therefore neither does the performance difference).
[1] https://github.com/python/cpython/blob/2.7/Python/ceval.c#L1...
[2] https://github.com/python/cpython/blob/master/Python/ceval.c...
Re:Records: Python library for making raw SQL queries to Pos...
by Redoubts on Monday February 08, 2016 @12:57PM
(#11059674)
It looks like list access got slower as a result though.
Re:Records: Python library for making raw SQL queries to Pos...
by dangoldin on Sunday February 07, 2016 @03:26PM
(#11054638)
Curious what the operations you're talking about are. Get?
Re:Records: Python library for making raw SQL queries to Pos...
by tveita on Monday February 08, 2016 @08:23AM
(#11057897)
Pickling, for one.
>>> nt = namedtuple('nt', 'a b')
>>> nt10k = [nt(1, 2) for i in range(10000)]
>>> dict10k = [{'a':1, 'b':2} for i in range(10000)]
>>> timeit pickle.dumps(nt10k)
10 loops, best of 3: 26.3 ms per loop
>>> timeit pickle.dumps(dict10k)
100 loops, best of 3: 2.49 ms per loop
Re:Records: Python library for making raw SQL queries to Pos...
by pyre on Sunday February 07, 2016 @06:45PM
(#11055585)
If you look at the the StackOverflow in my sibling comment to yours, running 'obj.attrname' on a namedtuple takes longer because it needs to translate 'attrname' to an integer index and then run (e.g.) 'obj[0]'. Outside of that, I'm not sure.