It's possible to completely bypass banks, yes. It would involve a physical cash to bitcoin exchange where you hand someone the money and they deposit the bitcoins at the address you specify.

Nothing stops shops from refusing bitcoin, but the same applies to USD.