shishirpatil
LLM Agent Arena from Gorilla X Lmsys Chatbot Arena
Llama 3.2 1B and 3B on-device models
BFCL V3: LLM Multi-Turn and Multi-Step Function Calling Evaluation
Berkeley Function Calling Leaderboard v2 with User Contributed Data
Autonomous LLM agents with human-out-of-loop
Andrew Ng on LLMs and Tool Use
New Leader Alert: Anthropic's Claude3 Tops Berkeley Function Calling Leaderboard
If you are using LLM RAG – you should be doing RAFT
Berkeley LLM Function-Calling Leaderboard and State-of-Art OpenFunctions-v2
Gorilla Openfunctions: Apache 2.0 function calling LLM
Re:MemGPT – LLMs with self-editing memory for unbounded context
on Monday October 16, 2023 @03:26PM (#37904971)
Hey @behnamoh, maybe you are referring to the community post pre-release? It is still very much live here: https://news.ycombinator.com/item?id=37894403!
As we released MemGPT this morning (including discord bot, and on Twitter), we took the community feedback to emphasize more on the context length in the title :) Thank you all for the feedback and keep it coming - we are listening!
Re:MemGPT – LLMs with self-editing memory for unbounded context
on Monday October 16, 2023 @02:36PM (#37904129)
Thanks @wilg and @littlestymaar ! Yeah totally, with the benefit of hindsight, this makes total sense! Hope you find some of our codebase useful to build on top of. We are an Apache 2.0 licensed open source project and welcome contributions :)
Re:MemGPT – LLMs with self-editing memory for unbounded context
on Monday October 16, 2023 @02:32PM (#37904081)
Yeah! While it’s not known what close-sourced models do, what we think is happening based on some prompt attacks, is that they also use recursive summarization (in addition to what others have mentioned in this thread).
Re:MemGPT – LLMs with self-editing memory for unbounded context
on Monday October 16, 2023 @02:31PM (#37904064)
Yeah absolutely! And hopefully with some of the techniques we introduce here, we can think of designing perpetual chat bots!
MemGPT – LLMs with self-editing memory for unbounded context
Re:Fig Has Joined AWS
on Monday August 28, 2023 @08:27PM (#37302057)
Check out Gorilla-CLI. An open source alternative to Fig, that’s also LLM powered!
Re:Gorilla-CLI: LLMs for CLI including K8s/AWS/GCP/Azure/sed and 1500 ...
on Friday June 30, 2023 @03:45AM (#36531760)
Thanks for the feedback, @dievskly. Will update it in the next release!
Re:Gorilla-CLI: LLMs for CLI including K8s/AWS/GCP/Azure/sed and 1500 ...
on Friday June 30, 2023 @03:43AM (#36531747)
Thanks for sharing @iandanforth and @distortionfield, nice project! Are there any additional features, Gorilla can support to make it useful for you folks!
Re:Gorilla-CLI: LLMs for CLI including K8s/AWS/GCP/Azure/sed and 1500 ...
on Thursday June 29, 2023 @10:53PM (#36529964)
Thanks for the feedback, @satokema. We currently mention it in our GitHub, pypi readme, and at install. Would you prefer different wording?
Re:Gorilla-CLI: LLMs for CLI including K8s/AWS/GCP/Azure/sed and 1500 ...
on Thursday June 29, 2023 @10:43PM (#36529899)
I think the use cases are where you roughly remember the commands but not the full command. Like rather than you looking up a man page you could potentially use this. An expert in one field may not be in another, so they might also find this useful!
Re:Gorilla-CLI: LLMs for CLI including K8s/AWS/GCP/Azure/sed and 1500 ...
on Thursday June 29, 2023 @10:41PM (#36529884)
No commands are executed without the users explicit approval! So, you could always execute any command anyways if you had access to the terminal!
Re:Gorilla-CLI: LLMs for CLI including K8s/AWS/GCP/Azure/sed and 1500 ...
on Thursday June 29, 2023 @10:40PM (#36529877)
haha. It's a great Open source project!
Re:Gorilla-CLI: LLMs for CLI including K8s/AWS/GCP/Azure/sed and 1500 ...
on Thursday June 29, 2023 @06:49PM (#36527927)
Thanks @ofermend, we believe that Gorilla will hallucinate lesser than other models but it's not zero yet! We will continue to reduce hallucination. Thanks for the feedback!
Re:Gorilla-CLI: LLMs for CLI including K8s/AWS/GCP/Azure/sed and 1500 ...
on Thursday June 29, 2023 @06:47PM (#36527912)
Hey @linuxdude314 thank you for the comment. As we mentioned commands are executed solely with your explicit approval; And while we utilize queries and error logs (stderr) for model enhancement, we NEVER collect output data (stdout). This is a stronger guarantee than many of the other LLMs out there and our goal is to help this inform our research.
One of the reasons we open-sourced the front-end, is that if you would like to keep everything private, you can just clone the repo, comment out the logging, install it, and we will still honor and serve your queries if you hit our hosted end-point :) Let us know if there is anything more that we can do to make you comfortable in using our tool!
Re:Gorilla-CLI: LLMs for CLI including K8s/AWS/GCP/Azure/sed and 1500 ...
on Thursday June 29, 2023 @03:51PM (#36525798)
Oo good suggestion @razzypitaz. We'll try to incorporate this in the next release :)
BTW it's open sourced, so if you would be interested in raising a PR would love to have you as a contributor!
Re:Gorilla-CLI: LLMs for CLI including K8s/AWS/GCP/Azure/sed and 1500 ...
on Thursday June 29, 2023 @03:48PM (#36525776)
Nope. No API key needed since we mostly serve our own Gorilla models.
Re:Gorilla-CLI: LLMs for CLI including K8s/AWS/GCP/Azure/sed and 1500 ...
on Thursday June 29, 2023 @02:48PM (#36524962)
Yes indeed. The models are too computationally expensive to run locally (7.5Billion parameters). Though you could in-principle swap in any local model.
Re:Gorilla-CLI: LLMs for CLI including K8s/AWS/GCP/Azure/sed and 1500 ...
on Thursday June 29, 2023 @02:09PM (#36524407)
Hey HN! As one of the contributors and author of Gorilla, we want to express gratitude for your valuable feedback. The community's desire for a straightforward method to invoke Gorilla led to the development of this CLI tool. We appreciate your continued input, so please keep those suggestions coming!