From the article’s footnotes:

  If you assume 1 million DAU and 100M requests per day, trimming 1,000 tokens off of [the over-long system prompt] could literally save millions of dollars in inference costs per year

That should be corrected to “could literally lose millions of dollars in inference revenue per year”, which also goes some way toward explaining why it doesn’t happen.