News for hackers. Stuff that matters.
Re:The Secret Sauce behind 100K context window in LLMs: all ... by pmoriarty on Saturday June 17, 2023 @09:33PM (#36376492)
"I believe Anthropics' Claude is somewhat underappreciated. In some instances, it outperforms GPT4"

I've found Claude to be better than GPT4 at creative writing and explanations, while GPT4 seems to be better at logic-puzzlish stuff.

Re:The Secret Sauce behind 100K context window in LLMs: all ... by CSMastermind on Saturday June 17, 2023 @09:50PM (#36376582)
I'd be interested to know if you have specific prompts that demonstrate this. I have a list of tasks that I use to test out models and the only time I've seen a model do better than GPT-4 is Bard performing better at my research task with internet search enabled.

Anecdotally I do find myself using Claude for summarization. It does seem to require less prompt crafting to get good results so when I just need an article or YouTube video summarized it's nice to be able to just drop it in and be like, "summarize this"

Re:The Secret Sauce behind 100K context window in LLMs: all ... by Method-X on Saturday June 17, 2023 @11:39PM (#36377089)
You might like the Perplexity Chrome extension[1]. I've found whatever technique they're using to be the best at summarization.

1. https://chrome.google.com/webstore/detail/perplexity-ask-ai/...

Re:The Secret Sauce behind 100K context window in LLMs: all ... by CSMastermind on Sunday June 18, 2023 @12:22AM (#36377297)
Oh very cool, thank you for sharing, I'll give it a try.