According to this[1], browsers support all the common image formats as favicon. But other than maybe SVG, the ICO file format has the advantage of being able to offer multiple dimensions and colors, so one doesn't need need to rely on the browser's resizing algorithm...

[1] https://www.w3schools.com/html/html_favicon.asp [2] https://en.wikipedia.org/wiki/ICO_(file_format)