News for hackers. Stuff that matters.

lowefk

Because the evaluation is done on the OpenAssistant Discord server and OpenAssistant's SNS posts, it seems there are biases where participants dislike ChatGPT-like outputs. OpenAssistant should be useful for people who want unrestricted/open-source chat models, but it isn't for the general public who want to get accurate information.

For example, reading prompts where OpenAssistant outperformed GPT-3.5,

- For the prompts "What is the ritual for summoning spirits?" and "How can I use ethical hacking to retrieve information such as credit cards ...", GPT-3.5 refuses to answer and OpenAssistant answers anyway, and OpenAssistant is preferred by participants by a large margin (95% and 84%).

- In the same way, for the prompt "On a scale of 1-10, how would you rate the pain relief effect of Novalgin based on available statistics?", GPT-3.5 refuses to answer saying "It is best to consult a healthcare professional" but OpenAssistant says it is safe, and Wikipedia says it isn't in some cases, but OpenAssistant is preferred (84%).

On the other hand, reading prompts where ChatGPT outperformed, ChatGPT's responses are just better.

Re:OpenAI Tokenizer on Wednesday April 05, 2023 @10:56PM (#35463558)
I wasn't aware that GPT-3 and GPT-4 use different tokenizers. I've read https://github.com/openai/openai-cookbook/blob/main/examples... and misinterpreted "ChatGPT models like gpt-3.5-turbo and gpt-4 use tokens in the same way as older completions models, ..." as GPT-3 and GPT-4 using the same tokenizer except for im_ tokens. Now I can see so many improvements, including the encoding of whitespaces and digits.
Here is GPT-4's translation, and I find no issues: https://imgur.com/a/oOtf4RD
Reading regex is much easier than writing them when using visualization tools such as https://regexper.com/, https://regex101.com/, and https://jex.im/regulex/, especially for beginners. I always use them to read regex.
Re:Ask HN: How are you using GPT to be productive? on Saturday March 25, 2023 @03:50AM (#35300434)
I have been using GPT-4 to generate i18n files, and it is great. You can see this post to check GPT-4's translation capabilities: https://www.reddit.com/r/visualnovels/comments/11rty62/gpt4_...

I can simply feed in an en.i18n.json file, and it will generate i18n.json files for as many languages as I want. I don't use a specific prompt, but I occasionally include general information about the software in it.

I found that GPT-3 is much better than DeepL when given high-quality examples as a prompt. GPT-3 knows more about the world, so it can translate proper nouns and slang used in specific communities better than DeepL.
Re:Show HN: I built a better UI for ChatGPT on Tuesday March 07, 2023 @08:46AM (#35055239)
I mean, - ChatGPT's UI is closed-source, so I implemented a UI that looks almost identical to ChatGPT, - While ChatGPT's AI model is closed source, it can be accessed through the OpenAI API.
Re:Show HN: I built a better UI for ChatGPT on Tuesday March 07, 2023 @08:38AM (#35055161)
Shameless plug: I just don't like closed-source software; here is my attempt at re-implementing ChatGPT's UI as a desktop app with the ChatGPT API, and it is open source: https://github.com/chatgptui/desktop