https://mybinder.org/v2/gist/gpavanb1/30a27c0592dbb23311f165dae4549309/HEAD?urlpath=voila%2Frender%2Ftoken_thermodynamics.ipynb

We often focus on tokens/second and dollars/token, but rarely on the environmental cost per token. This work presents a step-by-step analysis of the energy and water footprint of LLM inference.