Besides GPUs, memory (DRAM), storage (SSDs, hard drives), wired networking (Ethernet, Thunderbolt, Fibre Channel), wireless networking (WiFi, Bluetooth, cellular) and displays (monitors, VR) are all still keeping pace with their respective versions of Moore's Law. Of course they still aren't going to catch up to CPUs any time soon. (Never in the case of networking, since light travels only so fast).