So price does indeed become an issue because they're different buying segments. People shopping for the larger vehicles tend to be buying them because of greater usability and comfort for driver and passengers.
The Model 3 sits firmly in the compact sedan segment, something entirely different. The people buying those are either looking for pure economy while not having the issues of a used car (in which case starting price is around $20,000), or they're buying in the luxury car segment which is where the M3 is, meaning it's no different then buying an Audi A3.
For me it’s the utility factor. I can get a well equipped, 4 door Tacoma for $32k. That’s a hell of a lot more useful to me than a $40k Tesla. Perhaps if Tesla had a small sized pickup for less than $45k I’d give it a look, but their lower-end options just aren’t that attractive.
When you’re looking at a vehicle that’s the size of a civic, that isn’t a fun sports car, I just don’t see how the average American can justify it. I’m not exactly sure who Tesla Model 3 is supposed to be competing with. It’s not cheap enough to compete with Honda, Toyota, etc. and it’s not expensive enough to compete with luxury brands like Mercedes, Lexus, etc.
I expect Tesla sales to increase further with the introduction of the Y crossover built on the 3 platform.