Re:What's Next for Nvidia?
by sjdh76 on Sunday November 15, 2026 @08:40PM
(#50513002)
Yup. There are so many layers the majority doesnt interact with, so they focus on what they know. The current stack has probably 10-12 layers. And NVIDIA touches more layers than anyone else.
1. Physical infrastructure - power, cooling, network fabric, chip fabrication
2. Chips
3. Low level sw - CUDA/ROCm/Metal/XLA etc
4. Kernels - cuBLAS, cuDNN, FlashAttention, FlashInfer, Triton, llama.cpp
5. Kernel gen/optimization - MLIR, TVM, TensorRT
6. ML frameworks pytorch, jax, tensorslow
7. Models - Llama, Qwen, Claude, GPT, Gemini
8. More tuning - vLLM, SGLang, TensorRT-LLM, DeepSpeed, Megatron-LM
9. API/SDK/Platform
10. Apps/Agents/Pipelines/Orchestration etc