Sounds like you didn't have receive side scaling enabled; by default flows are queued to core 0 to prevent reordering. If you enable RSS, your flows will be hashed to core-specific queues.

It's inaccurate to describe traffic processing as single-threaded in the kernel.