yyding
Re:Punica: Serving multiple LoRA finetuned LLM as one
on Wednesday November 08, 2023 @04:23PM (#38197263)
Good job!
I observed that you implemented many cuda kernels by yourselves. Just wondering your consideration or trade-off between implementating the kernels via pure CUDA code vs. implementing based on compiler like TVM/Triton.
Re:Hidet: A Deep Learning Compiler for Efficient Model Serving
on Friday April 28, 2023 @02:21AM (#35738075)
Hi, do you mind submitting an issue to the hidet github repo so we can have a look? Thank you!