News for hackers. Stuff that matters.
Re:Anthropic announces Claude 2.1 – 200k context, less refusals by eyegor on Tuesday November 21, 2023 @01:15PM (#38367599)
My understanding is they reduced the number of ensembles feeding gpt4 so they could support more customers. I want to say they cut it from 16 to 8. Take that with a grain of salt, that comes through the rumor telephone.

Are you prompting it with instructions about how it should behave at the start of a chat, or just using the defaults? You can get better results by starting a chat with "you are an expert X developer, with experience in xyz and write full and complete programs" and tweak as needed.

Re:Anthropic announces Claude 2.1 – 200k context, less refusals by s1gnp0st on Tuesday November 21, 2023 @01:51PM (#38368222)
Yep, I'm still able to contort prompts to achieve something usable; however, I didn't have to do that at the beginning, and I'd rather pay $100/mo to not have to do so now.