News for hackers. Stuff that matters.
Re:How to Grow Software Architecture out of Jupyter Notebooks by AboutTheWhisles on Wednesday December 12, 2018 @11:17AM (#18665128)
You can mitigate the reading from disk by memory mapping the file.

I don't think serialization is a problem either. It is possible to make data structures that always exist as a single span of memory, so that they don't have a separate serialized representation. Most data structures are better served like this anyway, since prefetching and linear memory access is a huge speedup over pointer chasing. Building a data structure out of many separate heap allocations will also slow it down.

There are no comments on this comment yet.