> Community Notes doesn't work by majority rules. To identify notes that are helpful to a wide range of people, notes require agreement between contributors who have sometimes disagreed in their past ratings. This helps prevent one-sided ratings.

More info can be found there.

The algorithm itself is open-source so you can audit it if you want. The raw data itself is also available for download so it can be scrutinized.