Silly reason, but I like that Sunday being the first day keeps the week symmetric. You have the first and last day of the week being days off (in most places), and you have Wednesday in the middle. It's not very logical, but neither is any part of our calendar system.