They may not be part of our physical world but that does not mean they don't exist independently:

https://plato.stanford.edu/entries/platonism-mathematics/#Ex...