News for hackers. Stuff that matters.

RuiWang0811

Re:Research Harness from First Principles on Tuesday September 22, 2026 @12:09PM (#49803607)
TLDR: we built Oh My Quant, a harness designed for research from first principles -> fast & cheap experiment running, monitoring and storing. Our harness with Opus is top 1 on MLE leaderboard.

The point is to let an agent spawn, run, and track a lot of hypotheses and experiments in parallel without confusing itself.

Most harnesses right now are for coding, which is fine for SWE but not ideal for research. Good research means shipping many hypotheses, experiments, and validations, instead of static PRs. We used Codex and Claude Code for a while, but they have poor research 'taste' and are bad at running and comparing multiple experiments.

We ended up designing Oh My Quant from scratch for our own research. The harness is built around hypothesis → experiment → evidence, with a few simple principles: no hardcoded workflows, main agent decides which subagents to spawn; cheap and fast experiment design and tracking; harness handles all tedious things like parsing experiment metadata, run and monitor experiment, store result metrics - and leaves the agent's entire context window free to do the intelligent judgement calls for research design.

there are loads of env businesses for coding tasks, enterprise tasks, computer use etc etc. we offer different envs from a niche industry, which just so happens to be a very hard data science task & where the data doesn't saturate. In order to build these you'd need niche expert knowledge.
We have experiments showing that agents at least can learn from the environment by overfitting on train. But we do not yet have full post train runs, mainly due to time. But follow our blog/X where we’ll regularly update our research
We use real historical market data for the environments. There is no parametric modelling involved.

The decay property refers to alpha that we give the agent for trade in the env - they are generated as tools.

No we sell our own research to AI labs as RL envs. Realistic RL envs grows in demand as labs seek better data train better models.

It’s a complimentary business. Simply put: we sell envs to labs, labs make better models, firms buy these models to make more profit. Everybody wins.

Yeah a competitor for us would be fellow quants doing the same thing. But even then every quant firm trades differently (and good ones all make money) so envs can still be sufficiently different.

languagelearner, I think you need to spend more time learning languages
this seems to be a common misconception, our envs use market data, but the goal is not (only) trading. Market data just happens to be a good source of hard data science tasks.

Re trading: I’d argue there is no such thing as solving investment nor is there “the one profitable strategy”. Every decision from personal risk appetite to trading horizon changes what is the optimal strategy for you and there are multiple strategies that make money.

Also note that even the most profitable alphas are no crystal balls. Someone else mentioned 5% correlation to future return - depending on horizon and data such level of correlation can make 9 figure PnL and is by no means easy to achieve

we do affine transformations of the data, so all return/ pnl measures are still the same as with untransformed data. The transformation doesn’t change the conditional distribution of the data, which is what alphas ultimately measure
not sure about your background, the trace shows the feature engineering the LLMs did
cofounder here - LLMs can do some model training, they train on ML competition data after all. But they do struggle with low signal to noise ratio of market data. But that’s exactly what our environments will teach.