News for hackers. Stuff that matters.
Re:Google Cloud TPU Multislice Training by rwitten on Sunday November 12, 2023 @04:52PM (#38244464)
For int8 we've done very precise ablations with deterministic data loading to show incremental impact: https://cloud.google.com/blog/products/compute/accurate-quan...

Totally agreed with all your comments! MaxText mainline is right now a reference implementation for users who have their own scientific opinions on model architecture and convergence. We're additionally hoping to let MaxText run compatibly with some open-source models for customers who want to use known good configurations.

There are no comments on this comment yet.