Ask HN: What's the best self hosted/local alternative to GPT-4?

Re:Ask HN: What's the best self hosted/local alternative to ... by seszett on Wednesday May 31, 2023 @10:24AM (#36138775)

My test for open models is surprisingly simple.

I just ask "What is the capital of France?" and I haven't had a correct answer yet in any model I tried. They often get Paris right at least, but most other details are wrong.

Guanaco says:

> The current capital of France is Paris. It has been so since 1982 when it replaced the previous one which was Vichy.

[ Parent | on HN ]

Re:Ask HN: What's the best self hosted/local alternative to ... by jhbadger on Wednesday May 31, 2023 @10:41AM (#36138953)

What model size? 7B? 13B? 33B? When people say "Guanaco" or "Alpaca" or "Manticore" they are referring to a whole family of models. The really small ones like 7B often are very weird.

[ Parent | on HN ]

Re:Ask HN: What's the best self hosted/local alternative to ... by simonw on Wednesday May 31, 2023 @10:30AM (#36138838)

I just got "The capital of France is Paris." from vicuna-v1-7B running entirely on my iPhone (using the MLC Chat app).

[ Parent | on HN ]

Re:Ask HN: What's the best self hosted/local alternative to ... by edgyquant on Wednesday May 31, 2023 @11:44AM (#36139663)

>They often get Paris right at least, but most other details are wrong.

[ Parent | on HN ]

Re:Ask HN: What's the best self hosted/local alternative to ... by whimsicalism on Wednesday May 31, 2023 @12:02PM (#36139913)

What other detail in that statement is wrong?

[ Parent | on HN ]

Re:Ask HN: What's the best self hosted/local alternative to ... by ac29 on Wednesday May 31, 2023 @12:18PM (#36140105)

Guanaco 7B gives the same exact answer.

[ Parent | on HN ]