Never mind how crazy is your idea, there is always somebody that it's already trying it:

https://www.zero2infinity.space/bloostar/

Of course, you still have to accelerate to orbit, but you don't have to deal with the atmosphere.