Faster upserts directly benefit from indices on the write side and the read side benefits from fast lookups.

I thought it was more for writes, but reading here looks like the index will also help reads

Yes. Indexes are integrated into reads, with (near) standard SQL for managing them