You've been very unlucky in that the referendum came before you could become a citizen, but I do believe it is right that the poll was restricted to citizens and certain classes of other permanent residents[0].

[0] https://fullfact.org/europe/who-can-vote-eu-referendum/