I would think the difference would be from the data input pipeline, efficiency in batching, updating online models. The inference itself would be the exact same.