Fleece is one of my exceptions-to-the-rule re: polyester. That said, there's a big difference between investing in a nice, well-made fleece jacket that you know will last many years, and one that is likely to get destroyed pretty quickly. I'm happy to spend 2x as much on the jacket if it will last 2-3x as long.

Especially because, as you mentioned, more expensive jackets are sure to have better features (bigger pockets, better cut/shape, and a higher-quality fabric).