> the model starts with an unsupervised naive translation model obtained by making word by word translation of sentences using a parallel dictionary learned in an unsupervised way

So they DID have a parallel dictionary at first. How they learned it is another problem.