If that's a rights issue, we'll definitely add a link to the source. For now, you can right click -> open in new tab to see where it came from, but we'll look into this asap.

The goal here is to give people the opportunity to remove images they don't want in this dataset or add images they do want in there.

That's not how this works. Copyright owners have the right to control when, where, how and by whom their content may be used.

Not you https://www.law.cornell.edu/uscode/text/17/106

Isn’t this fair use? Copyright holders don’t get to opt out of fair use, correct?

Fair use doesn't apply here.

It’s clearly transformative so I cannot see a good argument for why it does not apply here. Do you have one?