The biggest difference I've found (moreso on stainless steel than cast iron) is food weight: which is to say, time food is left without moving.

Which makes sense. Essentially burnt-to-pan bits are food-pan interface, as opposed to food-oil-pan interface.

Give enough time, heavy food displaces oil and comes in direct contact with pan. Given enough movement, oil is able to reimpose itself between the two.