My experience working in FAANG.. Nobody knows

we need a Nate Bargatze skit for these quips

Would be nice to have an official confirmation. Once token get back to the user those are likely already counted.

Sucks when the LLM goes on a rant only to stop because of hardcoded safeguards, or what I encounter often enough with Copilot: it generates some code, notices it's part of existing public code and cancels the entire response. But that still counts towards my usage.

Copilot definitely bills you for all the errors.

Gemini appears to bill random amounts for reasons nobody knows.