Rather, as also mentioned in the answers, on Hollerith cards, 5-digit encoded (2 for the year, 3 for the day of year). Punch-card appliances were very much a thing. (WWII logistics were run by punch-cards.)
They were coded with 6 digits: 2 for month, 2 day and 2 year according to the SSA.
https://www.ibm.com/history/social-security-act
https://www.ibm.com/history/punched-card#The+Social+Security...
And the SSA site mentions using IBM machines for it in 1936. IBM machines only used IBM cards:
https://www.ssa.gov/policy/docs/ssb/v69n2/v69n2p55.html
The checks used to pay people were also IBM punchcards.
They changed the format to 80x10 with rectangular punches in 1928, naming it the IBM Computer Card. They modified it to 80x12 in 1930. IBM themselves distinguish between Hollerith's cards and IBM cards, but I suppose they were the same physical size and old names die hard.
They didn't get their first computer until 1956 and by that point, the 1875 date would have made little sense.
It simply makes more sense there was data entry errors. Indeed, we know there are since the SSA makes records available for dead people. They show people supposedly born as early as 1800:
https://aad.archives.gov/aad/fielded-search.jsp?dt=3059&tf=F...