Ask HN: Versal HBM Series vs. Nvidia A100 for LLM Training?

Re:Ask HN: Versal HBM Series vs. Nvidia A100 for LLM Training? by brucethemoose2 on Saturday November 04, 2023 @03:39PM (#38144410)

Well, this post is the second result for even running llama on Versal, so...

I think MLC-LLM (though TVM) can maybe run inference?

[ Parent | on HN ]

Re:Ask HN: Versal HBM Series vs. Nvidia A100 for LLM Training? by manili on Saturday November 04, 2023 @04:54PM (#38145019)

Thanks a lot @brucethemoose2 Are there any evidences and studies (e.g. papers, case study, etc...) regarding possibility/impossibility of training or running the architecture on top of the infrastructure?

[ Parent | on HN ]