A coffee (espresso) cup is not a tea cup. I've lived both in and outside UK, and I've always seen a standard tea bag with a bigger 250 ml plus cup (imagine the ubiquitous red Nescafe one)
I've never seen anyone drink a teabag out of an espresso cup. You can, but it's non standard.
Average where? The most standard Ikea cup [1] that I can see in all the offices around here is 8oz, which is around 230ml. Personally, I drink coffee from that, but for tea, I always use some of the 10oz cups, which is more along the line of 300ml. A tea bag for 300ml is perfectly acceptable in my mind.
[1] https://www.ikea.com/us/en/p/faergrik-mug-stoneware-white-60...