Ran into the same problem with my a recent website. I think I am still going to create at least one smaller version for mobile.

Additionally to your technique I defined a really small image as a background image in order to get a “progressive loading for avif” kind of effect on slower connections.

https://gutshaeuser-ostpreussen.de/