If by "not regurgitating racism" you mean "ignore statistics and Bayes' theorem while making predictions", why would anyone want that?

One would think a much more basic model without built-in affirmative action would produce better hiring decisions.

It's trained on random text scraped from Reddit, not statistics.

For the kind of reasoning and conclusions it can make you're making Reddit a compliment.

What statistics?

If you're using ChatGPT to make hiring decisions, you're incompetent as a hiring manager.

A competent hiring manager could well trust AI to shortlist 10 CVs out of 1000. If he wants to hire those most qualified, he'd better get just that, not a list maximized by some vogue metric of the day.

1. Throw away 9 out of 10 resumes randomly

2. Ask ChatGPT to pick 1 out of 10 resumes

Which one is worse? In reality you just can't read all resumes carefully.

You don't need to reed resumes carefully. I do a lot of hiring, and it takes around 30 seconds to classify which bin should a resume go.

I see. You're very confident of your competency. Good for you.

I, personally, trust ChatGPT's judgement more than one made by a human under 30 seconds. Even for a legal or coding or medical question I'll choose ChatGPT every time if the human professional has only 30 seconds to answer. I can't even trust myself to write binary search in 30s, and I'll avoid working with someone who think they can.

I don't think this requires any special competency to be confident of. What you need to answer when reading a CV is a) is there any evidence of relevant work experience and education, and b) is the resume properly formatted and contains no obvious typos. Everything else requires a conversation (at least for me). Using ChatGPT for this is a waste of computing power.