News for hackers. Stuff that matters.

A comment on Ask HN: When/where can we get an offline GPT3 type chatbot?. Parent comment

Re:Ask HN: When/where can we get an offline GPT3 type chatbot? by piecerough on Wednesday December 07, 2022 @07:00PM (#33902179)
InstructGPT is actually 1.3B, you don't need 175B like initial GPT-3 model: https://openai.com/blog/instruction-following/

ChatGPT is likely a much better variant, but also must be still small and will likely be portable.

[ Parent | on HN ]
Re:Ask HN: When/where can we get an offline GPT3 type chatbot? by tripplyons on Wednesday December 07, 2022 @08:06PM (#33902752)
ChatGPT is based on GPT3.5 which is a series of 175B models that includes code-davinci-002, text-davinci-002, and text-davinci-003. I do not think of it as portable.
[ Parent | on HN ]
Re:Ask HN: When/where can we get an offline GPT3 type chatbot? by ActorNightly on Thursday December 08, 2022 @01:13PM (#33911097)
Would it be possible to run this entire model sequentially, dumping intermediate results to SSD?
[ Parent | on HN ]
Re:Ask HN: When/where can we get an offline GPT3 type chatbot? by PartiallyTyped on Thursday December 08, 2022 @04:21AM (#33905974)
Network distillation to the rescue! Provided that you have the means to distill in the first place :D
[ Parent | on HN ]