Are you aware that malloc() is slow and doing all these tiny allocations is probably the biggest bottleneck in your program?