I believe they also add a loss term corresponding to translating A to B using last iteration's model, then translating that B-sentence back to A and comparing to the original sentence.