Tenstorrent Engineers Talk Open-Sourced Bare-Metal Stack

Re:Tenstorrent Engineers Talk Open-Sourced Bare-Metal Stack by sashank_1509 on Monday February 05, 2024 @11:01AM (#39262588)

So right now it’s only for model inference is it and not for training

[ Parent | on HN ]

Re:Tenstorrent Engineers Talk Open-Sourced Bare-Metal Stack by wslh on Monday February 05, 2024 @11:57AM (#39263422)

Good question. I have been compiling an analysis of the hardware market with the idea of analyzing a cloud market for LLMs. Feel free to comment: https://docs.google.com/document/d/1nehciIpaKj3-sEta5Jx2q9in...

I am mainly interested in the training side because it is the more difficult one.

[ Parent | on HN ]

Re:Tenstorrent Engineers Talk Open-Sourced Bare-Metal Stack by adifrancescoTT on Monday February 05, 2024 @12:52PM (#39264185)

Correct, working on enabling training on next iterations

[ Parent | on HN ]

Re:Tenstorrent Engineers Talk Open-Sourced Bare-Metal Stack by shubham_saboo on Monday February 05, 2024 @12:53PM (#39264206)

Yes, Grayskull is Tenstorrent's entry-level devkit for inference only. Future generation of chips to feature training.

[ Parent | on HN ]