News for hackers. Stuff that matters.
Re:Open source inference time compute example from HuggingFace by srush on Friday December 20, 2024 @09:14AM (#42471216)
For problems that require multi-step reasoning, standard LLMs seem to be stuck. The field is increasingly interested in models like o1 that output many "guesses" to find the right one. Currently open-source does not know how to do this, but we are reimplementing several possible directions to try. This replicates one important path using search and a verifier model.

There are no comments on this comment yet.