> If I can use your AI completely offline on my device on a spaceship orbiting Pluto
And the answer was yes. I do not know the exact system requirement of the current ChatGPT, but I am fairly confident
1) ChatGPT no network mode could fit in a half of a server rack, maybe way less.
2) You can fit half a server work on a spaceship that can go to Pluto.
My guess is it's more like 1 server worth. Google tells me GPT3 was 1TB which is a very small laptop.
Sidenote, ChatGPT uses tens of thousands of GPUs to run its architecture, I think it'll take a little more than just some laptop.
Thank you for answering though :) I do think its an invaluable goal to have off-line first AI.
For example - The Tesla self driving AI takes many hundreds (thousands?) of computers to build the model. Then it runs in realtime of 1 "GPU" that lives in my car. It's not sending frames in realtime to a supercomputer to process.
So for a spaceship - same thing. You don't need to send the thing that makes the model. You just send a finished model and a GPU to run it.