Context is king. Language is pretty verbose, most of the time you can understand the gist without understanding 100%. So at least you can make a start - that's the first step! It doesn't have to be perfect. Granted, the French can be gruff about it, but most cultures appreciate you trying to learn and will accommodate you a bit.

It could be the training material. I'm an auditory learner and the Michel Thomas courses work amazingly for me. I also ignore spelling until later, because I find conversations much more important and also pleasurable (so I'm more likely to stick with it). My English spelling was atrocious, I still rely on Chrome's spellchecker (actually, so do many of my English friends!).

Keep at it, everybody's different!