News for hackers. Stuff that matters.

A comment on Punica: Serving multiple LoRA finetuned LLM as one. Parent comment

Re:Punica: Serving multiple LoRA finetuned LLM as one by abcdabcd987 on Wednesday November 08, 2023 @06:50PM (#38198946)
Thanks for the question. Currently Punica is on the ecosystem of PyTorch and HuggingFace Transformers. So PyTorch users can start to use Punica now.

Look forward to collaboration with TVM and MLC to reach more users :)

[ Parent | on HN ]

There are no comments on this comment yet.