A great statistics textbook along these lines is Principles of Statistics by MG Bulmer. It's one of those Dover classic textbooks that you can get for cheap. This book assumes you already know basic calculus and combinatorics. It then goes through a series of practical problems, and shows how you can use calculus or combinatorics to solve them. And, along the way, an intuitive and holistic perspective on statistics begins to form.
The overall effect is great. It's a lot like a 3blue1brown video series, only from the 1960s, and with problem sets.
Additionally it's quite useful to have the background to understand the differences between Pearson correlation and Spearman rank, or why you might want to use Welch's t-test vs students, etc.
Not that you should know all of these things off the top of your head necessarily, but you should have the foundation to be able to quickly learn them, and you should know what assumptions the tests you're using actually make.
We don't need first principals thinking for every thing. Granted, this comment is a bit vague, so I don't know how exactly you were taught or which type of class we're talking about, but generally, you can accept some axioms in applied mathematics classes. If we're talking the bare minimum classes like in the article (for apparently a business degree), this is likely a high level applied prob/stat. Things tend to get more in depth with higher level pure mathematics courses.