News for hackers. Stuff that matters.
Re:Ingesting PDFs and why Gemini 2.0 changes everything by kettleballroll on Thursday February 06, 2025 @01:25AM (#42959629)
I thought the temperature only affects randomness at the end of the network (when turning embeddings back I to words using the softmax). It cannot influence routing, which is inherently influenced by which examples get batched together (ie, it might depend on other users of the system)

There are no comments on this comment yet.