AlexChen-NexaAI

Re:Octopus v2: On-device language model for super agent on Thursday April 04, 2024 @06:52PM (#39936796)

Yes, you can do that! We have experimented about this idea. The lora training is reported in the paper already, and it works well. I think it would be very interesting.

Re:Octopus v2: On-device language model for super agent on Thursday April 04, 2024 @06:51PM (#39936783)

Thanks for your sharing. I am the author of this paper. You can have a try of our model, and another YouTuber created a tutorial video to use our model.

https://huggingface.co/NexaAIDev/Octopus-v2 https://www.youtube.com/watch?v=WJM8AIBHgXo

One note is that we haven't tested how many tokens the model can process. Query over 30 tokens is acceptable. We will follow up on this issue. The number 30 is summarized from the ordinary queries in an Android use case.