You just listed a lot of tools where a deep knowledge of data structures is extremely important :)

Most of these things need to be created to scale and stabilize the existing system.