News for hackers. Stuff that matters.
Re:Machine learning saves us $1.7M a year on document previews by joosters on Wednesday January 27, 2021 @05:07PM (#25934706)
Is the cost saving really measuring the right thing? Instead of comparing against the cost of pre-generating and caching every file preview, shouldn’t they be comparing against he cost of adding enough infrastructure (or just optimising their preview code) to make on-the-fly preview generation acceptably fast?
Re:Machine learning saves us $1.7M a year on document previews by wsuen on Wednesday January 27, 2021 @06:34PM (#25935678)
Hi joosters, thanks for the question. It is always a good practice to ask if we are solving the right problem.

The decision to prewarm is ultimately a product decision to give users a better experience across the many surfaces where they encounter file previews. There are limitations to how fast previews can be generated on the fly, even under optimal conditions (unlimited top-of-the-line hardware, max of 1 request at a time). For instance, optimal on-the-fly preview generation for more expensive files (say, a video that is an hour long or a gigapixel image) can add 10s of seconds to tti -- not good from a user perspective!

Given this constraint, we wanted to optimize where we spend on the preview generation infrastructure without negatively impacting the user experience. We chose to do this with a combination of heuristics and the ML solution described in the article.

Re:Machine learning saves us $1.7M a year on document previews by catmanjan on Wednesday January 27, 2021 @07:45PM (#25936529)
Couldn't you just load the first frame of the video, and aren't most image formats optimized for fast thumbnailing? I take your point that there are times when it will be slower, but are you saying that you assumed ML would be faster than on the fly, or did you actually check?
Re:Machine learning saves us $1.7M a year on document previews by ddorian43 on Thursday January 28, 2021 @03:57AM (#25939741)
> Couldn't you just load the first frame of the video

No, often it's black. You have to do scene-detection if you want meaningful previews/thumbnails, can't always go random about it.

And the original files are stored in HDD and not SSD/RAM.

Source: I don't work there.