Minimal implementation of Mamba, the new LLM architecture, in 1 file of PyTorch

Re:Minimal implementation of Mamba, the new LLM architecture... by pshc on Wednesday December 20, 2023 @12:24PM (#38711068)

Perhaps the community at r/localllama could train an LLM that knows about the latest developments and explains jargon and papers, updated weekly. Free idea for karma.

[ Parent | on HN ]

Re:Minimal implementation of Mamba, the new LLM architecture... by wenc on Wednesday December 20, 2023 @12:34PM (#38711206)

Not a bad idea.

I actually read papers with the help of ChatGPT-4 and Claude. It helps me quickly understand papers that I don’t have a background in.

For instance when I see something I don’t understand I ask it “can you break that down for me?” Or “is this similar to (concept I know)?”

It’s the new way of doing syntopical reading — but faster and more efficient.

(For the uninitiated, it’s a technique from Mortimer Adler’s How to read a book)

[ Parent | on HN ]

Re:Minimal implementation of Mamba, the new LLM architecture... by ttul on Wednesday December 20, 2023 @01:38PM (#38712040)

This is a great way to consume papers. If there’s one thing LLMs know, it’s machine learning literature!

[ Parent | on HN ]

Re:Minimal implementation of Mamba, the new LLM architecture... by jsight on Wednesday December 20, 2023 @02:27PM (#38712550)

How do you feed a recent arxiv paper directly to ChatGPT?

[ Parent | on HN ]

Re:Minimal implementation of Mamba, the new LLM architecture... by WhitneyLand on Wednesday December 20, 2023 @02:46PM (#38712760)

A few options are:

1. Select abstract or select all text then copy/paste.

2. Save the PDF and upload with ChatGPT’s document feature.

3. Ask for it, “what’s that well known LLM paper about context and getting lost in the middle?”. It will web search as needed.

You can also do more than summarize. Ask about equations, ask it to make analogies, challenge the key findings as devil’s advocate to learn from different angles. Propose your own ideas.

Use voice to digest topics during your commute and ask tons of questions until you understand.

[ Parent | on HN ]

Re:Minimal implementation of Mamba, the new LLM architecture... by Min0taur on Wednesday December 20, 2023 @02:39PM (#38712678)

If you have the + subscription you can upload pdfs directly/ask it to ingest.

[ Parent | on HN ]

Re:Minimal implementation of Mamba, the new LLM architecture... by b4ke on Wednesday December 20, 2023 @10:49PM (#38716789)

You can visit the page and use edge browser copilot feature. It uses gpt4 and doesn’t cost anything ;)

[ Parent | on HN ]