While you're correct, it is historically a loanword from Portuguese, not from Spanish. You can verify this in your favorite 国語辞典 if you want to. Like many loanwords, the pronunciation got corrupted a bit. (An example in the other direction: Godzilla, which you'd have to take several stabs at before a Japanese person guessed you meant gojira.)