Re:ChatGPT can now see, hear, and speak – openai.com
by arktiso on Monday September 25, 2023 @03:31PM
(#37649310)
Wow, the latency on requests feels great!! I’m really curious: is this running entirely with Python?
[ Parent
| on HN ]
Re:ChatGPT can now see, hear, and speak – openai.com
by TheEzEzz on Monday September 25, 2023 @04:51PM
(#37650425)
100% Python but with a good deal of multiprocessing, speculative decoding, etc. As we move to production we can probably shave another 100ms off by moving over to a compiled system, but Python is great for rapid iteration.