Indeed. From an article here on HN there is a lack of vaapi support on Firefox and I think Chrome in linux. Furthermore there are special profiles(looking at you H264) that only work reliably in software decoders.