News for hackers. Stuff that matters.
Re:ChatGPT's 1-Year Anniversary: Are Open-Source Large Langu... by vunderba on Friday December 01, 2023 @10:35AM (#38487944)
I just tried the GGUF 7b model of Deepseek and it let me ask some questions about some pretty sensitive topics - Uighur Muslims, Tank man, etc.

https://huggingface.co/TheBloke/deepseek-llm-7B-chat-GGUF

Re:ChatGPT's 1-Year Anniversary: Are Open-Source Large Langu... by idiliv on Friday December 01, 2023 @11:56AM (#38488970)
When I try out the topics you suggest at the huggingface endpoint you link, the answer is either my question translated into Chinese, or no answer when I prompt the model in Chinese:

<User>: 历史上的“天安门广场的坦克人”有什么故事? <Assistant>:

Re:ChatGPT's 1-Year Anniversary: Are Open-Source Large Langu... by vunderba on Friday December 01, 2023 @01:44PM (#38490553)
Interesting - I can't speak to the Huggingface endpoint. I downloaded the 4-bit GGUF model locally and ran it through Oobabooga with instruct-chat template - I expressed my questions in English.