pseudotensor
One note on their speed comparison: the JevBench board shows self-hosted models with an adjusted latency of "2x + 0.15 s (assumption, not measured)". Our measured p50 is 29 ms; the adjusted figure is 0.21 s. They report 85 ms for theirs.
We released an Apache-2.0, open-weight 4B decision model that scores above Jev 1.13 on JevBench's composite score (72.5 vs 71.5) and is currently the top open model there: https://benchmarkheaven.com/jev-models . Newer models coming even larger than beat Jev in intelligence as well.
- Same contract as Jev: state + typed questions in, calibrated probabilities out, one forward pass, no generated tokens. - Your data never leaves your environment, and there's no per-call fee.
Weights, card and run instructions: https://huggingface.co/h2oai/h2o-lightning-4b
Protecting math jobs limits cancer progress even being a choice of what to pursue. You could choose to allow 24/7 surveillance, but why would you? At least with math progress society can choose what to allow from it, but slowing it down universally blocks all choices.
Physics and Biology will see major breakthroughs that WILL fundamentally alter our world. That is one key thing missing from alot of discussion here is the narrow focus on math (or parallels with software engineering). Doing well in math is key to doing well in physics and other sciences.
The idea is not silly in my view, I did something similar here: https://github.com/pseudotensor/open-strawberry
The idea is that data generation is required first, to make the reasoning traces. ToT etc. are not required.