It's very likely that OP is one of those "engineers" that replaces database lookups with asking an LLM.

So, presumably, instead of doing a cheap/free DB lookup, an AI is prompted for the information. "list all credit card rewards of XYZ in json according to this schema:..."

You have too much faith in these people