There are valid reasons for that [0]. Would you accept slower compile times and more memory usage just so you could have a 64-bit version of visual studio that your project probably wouldn't even need?

0: https://blogs.msdn.microsoft.com/ricom/2009/06/10/visual-stu...

That was 8 years ago. Surely things have changed...!

Physics haven't changed. If you double the size of all your pointers, you effectively reduce the available CPU cache. It will be slower.