nikshepsvn

thimble is a model i spent the last week of my evenings trying to train in order to beat needle 2 -- a 45M param tool-calling model trained on 153+ billion tokens by a funded team (u/cactuscompute)

my model: 48M params, ~1 billion tokens, $260 total (so 150x less training data)

the model wins 3 of their 5 published benchmarks, including seal-tools, the headline suite of their eval and the hardest one to move (so not a complete victory but still incredibly impressive results if i have to say so myself)

weights, code and results from every failed experiment is public -- and tbh all the fuck ups were the best part of the whole process, learnt a lot about synth data, model arch and training along the way

code: https://github.com/nikshepsvn/thimble weights: https://huggingface.co/flashvenom/thimble

i built this using openrouter data thought this might be useful for myself and other folk

collection of projects and writings

i love looking up new models to swap to and improve speed, reduce costs etc but its always a pain

this makes it so much easier

any attention is better than no attention, so here is my proposal to the void (:

would love thoughts and feedback, researched and written with the help of gemini and o3.

would love thoughts and feedback, researched and written with the help of gemini and o3.

one of my first posts on the platform! i quit my job last august and have been spending my time building experiments in AI and crypto -- during this time i spent a lot of time wondering about the future post actually good AI (context, hallucination etc solved) and this is my take on what companies might look like (and what I'm building SCULPT to become)

would love some thoughts, its ambitious but i do think we're headed there sooner rather than later