It depends on what your usecase is. If you are Netflix and you have a show that gets watched 5 million times then having 100x on encoding is no big deal.

However if you want to do live-streaming to a group of friends, its very impractical.

Its only really worth doing a lot of work the encoder once you are sure its not gone change anymore, so work on that is surely ongoing.