How about working with discrete batches? Update the first page only twice a day. I think this would be enough to drastically changed the dynamics.