News for hackers. Stuff that matters.
Re:Build Personal ChatGPT Using Your Data by yoyopa on Saturday July 08, 2023 @05:53PM (#36649164)
what hardware do you need for that?
Re:Build Personal ChatGPT Using Your Data by drdaeman on Saturday July 08, 2023 @06:07PM (#36649258)
Consumer-grade, AFAIK it's GPT4All with LLaMA.
Re:Build Personal ChatGPT Using Your Data by EGreg on Saturday July 08, 2023 @06:12PM (#36649303)
Link?
Re:Build Personal ChatGPT Using Your Data by hoopsman on Saturday July 08, 2023 @06:30PM (#36649417)
Re:Build Personal ChatGPT Using Your Data by raffraffraff on Sunday July 09, 2023 @02:47AM (#36652225)
That's doesn't really answer the question.

Neither does the github "System requirements" section, which I find disappointing. Ideally, it should give minimum memory requirements and rudimentary performance benchmark table for a sample data set, across a handful of setups (eg, Intel CPU, Apple M1, AMD CPU, with/without a bunch of common GPUs). With that information I would know whether or not it's worth my time even trying it out on my laptop.

Edit: lol, I went through 2 pages of the issues on the github page and most of them could be avoided by putting this basic information into the system requirements:

https://github.com/imartinez/privateGPT/issues/174 https://github.com/imartinez/privateGPT/issues/179 https://github.com/imartinez/privateGPT/issues/104 https://github.com/imartinez/privateGPT/issues/141 https://github.com/imartinez/privateGPT/issues/282 https://github.com/imartinez/privateGPT/issues/316 https://github.com/imartinez/privateGPT/issues/333

... And lots more! Some of these people have 128gb memory and 32 cores, and still find it "very slow". Others having memory pool errors. Some of the answers hand-waving at needing "a more better computer"

I reckon a lot of these issues could be closed and linked to a single ticket for proper hardware requirements in the readme.

Re:Build Personal ChatGPT Using Your Data by qingcharles on Saturday July 08, 2023 @07:31PM (#36649808)
It runs (slowly) on my 6 year old i5 laptop.