someguy101010

Yea it seems to be very jagged so far but will be training on more datasets.

I just added evals for existing datasets and some classic controls problems.

Will likely look for more commercial datasets and synthetic data too.

I’m funding personally in short term but if I can find some compute can see how well this scales!

a foolish consistency is the hobgoblin of little minds

you can use this for screenshots

https://huggingface.co/thaitea/laya-vision-smolvlm-256m

been loving hacking on this. just created a vision version of it here https://huggingface.co/thaitea/laya-vision-smolvlm-256m

been working on a javascript runtime for agents and recently got grpc working with modal!

Our cloud platform supports gpu but we haven’t shipped it yet. I’ll be sure to update guide when that’s shipped!

Totally agree. I’ve built a bunch of harnesses for Minecraft and a specialized one will almost certainly out preform a general purpose one.

I believe the way we advance the capabilities for general computer use is to to attempt harder and harder tasks with it, and build up the necessary infrastructure to accomplish it along the way.

Even when we don’t achieve the goal, the infrastructure we build is often useful for easier and more obtainable goals as well.

If your computer use environment can pilot Minecraft, it can also probably do your taxes

its not marketing to you, its marketing to agents looking for tools to use

You may have heard of Programmatic Tool Calling from anthropic or Code Mode from cloudflare for calling mcp servers. I have been working on an open source version of this and recently put together some basic docs, and thought this page would be a good one to share.

There are plenty of other features to explore, but this one alone has resulted in significant improvements in the speed of execution in many tasks including minecraft playing agents, computer use agents, and for querying and aggregating information from my telemetry systems in a lightweight low risk way.

if i didn't have to prompt it to learn from its mistakes and it just "intuitively" knew to do that

have built in this space which led me to develop a minizinc mcp server [0] for scheduling bocce tournaments [1]. scheduling with constraints is a np hard problem and it makes sense people struggle. tools exist to solve this problem but they are complex and hard to use for non technical folks, and even technical folks. am hoping a tool like this can bridge the gap and would like to bring it to your awareness if you aren't already thinking about the problem this way :)

edit: after reading a bit more of description looks like yall are taking a similar approach, kudos!

[0] https://github.com/r33drichards/minizinc-mcp

[1] https://github.com/r33drichards/bocce-scheduler

yep! thats the motivation behind https://github.com/r33drichards/mcp-js

I want to be able to give agents access to computation in a secure way without giving them full access to a computer

Does this support bedrock?

Is it possible to provide a llm a skill through the mcp resource feature?

as an infrastructure engineer the idea of being able to train computer use agents without provisioning infrastructure sounds amazing!

a common use case i run into is i want to be able to configure corporate vpn software on windows machines. is there a link for a getting started guide i could try this out with?

have used it, and i do like it, but the licensing situation is not great. It open source but its not free software by any means.

wrote about this a bit too in https://www.robw.fyi/2025/10/24/simple-control-flow-for-auto...

ran into this when writing agents to fix unit tests. often times they would just give up early so i started writing the verifiers directly into the agent's control flow and this produced much more reliable results. i believe claude code has hooks that do something similar as well.

clearly you have never worked in enterprise

nice one kyle! you could add https://github.com/wasmerio/webassembly.sh and have a fully featured in browser shell with support for installing packages!