Unless your network is poor, I’d imagine (but definitely could be wrong in your case!), the bottleneck is the LLM speed, not the latency to the data center its running in.
Re:How I Program with LLMs
by th4t1sW13rd on Tuesday January 07, 2025 @04:50PM
(#42628023)
Most editors I use supports online LLM but it's too slow sometimes for me.