News for hackers. Stuff that matters.
Re:The Secret Sauce behind 100K context window in LLMs: all ... by CSMastermind on Saturday June 17, 2023 @09:50PM (#36376582)
I'd be interested to know if you have specific prompts that demonstrate this. I have a list of tasks that I use to test out models and the only time I've seen a model do better than GPT-4 is Bard performing better at my research task with internet search enabled.

Anecdotally I do find myself using Claude for summarization. It does seem to require less prompt crafting to get good results so when I just need an article or YouTube video summarized it's nice to be able to just drop it in and be like, "summarize this"

Re:The Secret Sauce behind 100K context window in LLMs: all ... by Method-X on Saturday June 17, 2023 @11:39PM (#36377089)
You might like the Perplexity Chrome extension[1]. I've found whatever technique they're using to be the best at summarization.

1. https://chrome.google.com/webstore/detail/perplexity-ask-ai/...

Re:The Secret Sauce behind 100K context window in LLMs: all ... by CSMastermind on Sunday June 18, 2023 @12:22AM (#36377297)
Oh very cool, thank you for sharing, I'll give it a try.