As far as I understand, the trade-off of storing stale rows in a separate place is that you need to bring them back if the transaction rolls back, making rollbacks more expensive.

Also, you need to copy entire row before updating it or deleting it, not sure how significant this cost is in practice.