Groq runs Mixtral 8x7B-32k with 500 T/s

Re:Groq runs Mixtral 8x7B-32k with 500 T/s by itishappy on Monday February 19, 2024 @11:19AM (#39431470)

Alright, I'll bite. Haskell seems pretty unique in the ML space! Any unique benefits to this decision, and would you recommend it for others? What areas of your project do/don't use Haskell?

[ Parent | on HN ]

Re:Groq runs Mixtral 8x7B-32k with 500 T/s by tome on Monday February 19, 2024 @12:19PM (#39432223)

Haskell is a great language for writing compilers! The end of our compilation pipeline is written in Haskell. Other stages are written in C++ (MLIR) and Python. I'd recommend anyone to look at Haskell if they have a compiler-shaped problem, for sure.

We also use Haskell on our infra team. Most of our CI infra is written in Haskell and Nix. Some of the chip itself was designed in Haskell (or maybe Bluespec, a Haskell-like language for chip design, I'm not sure).

[ Parent | on HN ]

[dead]

Re:Groq runs Mixtral 8x7B-32k with 500 T/s by gotem02 on Saturday March 02, 2024 @07:13PM (#39577072)

Why? Is it just because it's too hard to read and write? Or is it lacking some features?

[ Parent | on HN ]