I recently started Immich and also say the awful lag. But apparently this is due to a slow "album sync" running often on the main thread. Not the fault of flutter.
I don't know how syncing my 200 albums can be that slow but they are a big project to move it off of the main thread.
I don't think that's the developers fault though, I don't have that issue with any other android app.