There's usually a lot more involved in charging a device, not to mention that USB-C can charge at 20V instead of just 5V. Charging speed is often based on current, but you also want to make sure you don't discharge too much current too quickly for various reasons (such as the battery capacity, and to prevent surges, etc). If you're curious, there are teardowns that go over chargers that discuss everything involved.