We do the masonry layout from left to right. This means we start filling out each row from the left and can leave space on the right of the last row of a page so the next page can begin filling in the remainder of that row before starting a new one. To do this the opposite way if we're "backfilling" photos seems like it could be significantly more complex.
In essence when scrolling "up" we'd have to reverse the alignment and fill photos in from right to left. This alone makes my head hurt to think about.
But aside from our implementation I think a bidirectional infinite scroll really is the solution to work towards. It would feel much more natural that way.
Then it is just taking a list of images, and moving the "view" forward or backward on that list, right?
_______________ | header | | | | buffered | | images up | |-------------| | | | Viewport | | | | | |-------------| | buffered | | images down | | | | | ---------------
Is this somehow technically very difficult or would this screw with usability in some way that would be unintuitive?