Re:Great interview with Erlang developer: Importance of bein...
by papersmith on Tuesday September 18, 2007 @05:43PM
(#56525)
I've heard that each Mnesia table is limited to 4GB. That sounds like a pretty serious limitation now-a-days. Not sure if there are any ways to work around that.
[ Parent
| on HN ]
Re:Great interview with Erlang developer: Importance of bein...
by simpleenigma on Tuesday September 18, 2007 @07:46PM
(#56570)
That is a limitation of the 32-bit OS ... If you are using a 64-Bit OS that is no longer a problem.
I have a 64-bit Xeon with 8GB of RAM and I have created tables lareger the 4GB as a test ... to make completely sure ...
Re:Great interview with Erlang developer: Importance of bein...
by papersmith on Wednesday September 19, 2007 @03:43PM
(#57025)
Does that apply to DETS storage as well?
It says on this page (http://erlang.stacken.kth.se/faq/x1197.html) that "Dets uses 32 bit integers for file offsets" and "In practice your machine will slow to a crawl way before you reach this limit."
Re:Great interview with Erlang developer: Importance of bein...
by simpleenigma on Friday September 21, 2007 @02:52PM
(#58039)
As far as I know it does ... the 32bit limitations in Erlang are more about the OS then anything else.
Re:Great interview with Erlang developer: Importance of bein...
by yariv on Tuesday September 18, 2007 @06:33PM
(#56550)
You can add table fragments to overcome this limitation. However, keep in mind that Mnesia isn't designed to store very large datasets. It works best with data sets that fit in RAM.
Re:Great interview with Erlang developer: Importance of bein...
by wmf on Tuesday September 18, 2007 @07:17PM
(#56563)
But RAM can be substantially larger than 4GB these days.
Re:Great interview with Erlang developer: Importance of bein...
by yariv on Tuesday September 18, 2007 @08:32PM
(#56588)
True. However, the reason Mnesia is better suited for in-RAM data sets is that its disk-only storage engine, dets, requires a potentially long repair process if the VM crashes and a dets table isn't closed properly. This could keep your table inaccessible for a while after you restart the VM.
Re:Great interview with Erlang developer: Importance of bein...
by acgourley on Tuesday September 18, 2007 @07:54PM
(#56574)
Heh, the same principal restricting the mnesia database to 4 gigs on a 32 bit system is restricting the ram size to 4 gigs on a 32 bit system. (Some OS/Hardware magic can get around this but for the most systems this is true).