Re:The PC is not dead, we just don't need new ones
by carterschonwald on Thursday October 24, 2013 @04:50PM
(#6607862)
exactly! This winds up being a memory locality / layout problem often times!
eg: most CPU memory traffic is in "cachelines" size chunks so you're best off trying to organize information so you can use all bandwidth! I've a few ideas on this i'm trying to bake into an array/matrix library i hope to release soon. :)
for example: random forest, gradient boosting, gam, etc -- you will typically do parameter searches and the models you get are as good as your willingness to wait. Good software will run at a significant fraction of memory bus speed and the faster that bus goes the better your models will be.