Re:Torch7 – Scientific computing for LuaJIT
by neomantra on Monday June 23, 2014 @09:08AM
(#7931695)
This is a big annoyance for me as well. I use jemalloc to make sure that my FFI allocations don't 'steal' this lower memory from my pure Lua allocations. It works great on Linux, but only so-so on OSX.
http://www.canonware.com/pipermail/jemalloc-discuss/2014-Feb...
http://hacksoflife.blogspot.com/2012/12/integrating-luajit-w...
Edit: to clarify, this does not mean torch cant use more than 2GB, but native lua allocations cant be more than 2GB, so ffi-based or C based allocations (which is how torch tensors are allocated) have no such limits.