Humans decided scale matters. Our legal systems explicitly say so. Sentencing guidelines for fraud are quite explicit. Society makes those laws.

Society is effectively ok with you ripping me off for $1. They are not when it's $100k.