Spreadsheets freeze to process more than 1 million records; AWK works like charm;

https://blog.jpalardy.com/posts/alternative-to-sort-uniq-c/