>I’ve never actually gone to a bank first before buying a car.

I don’t think you’re paying much attention to what you sign when buying a car, you don’t go to a bank, there’s a person at the dealership who sets the loan for you from different banks. There are buy-here pay-here which is financed by the dealership but that is usually for conditions that banks won’t accept like rebuilt title vehicles, heavily modified or too old.