theonlyt3

Pretty cool - surprising to me that you can't just do this in Google Drive

Is there a different approach compared to other AI headshot generators? e.g., aragon.ai

It's ok if not - mostly just curious

Great question!

We actually included a basic form-filling example (data_entry_example.py) in our GitHub repo—definitely give it a spin and see how it goes.

One tip: filling out forms is currently a bit slow since each step runs sequentially. We're actively looking into concurrency improvements (for example, calculating multiple field interactions at once) to speed things up.

Excited to hear how it works for you—feel free to share any issues or feedback you run into!

Good question!

Probably the most surprising/interesting one I've seen is automating job applications. Essentially spinning up multiple concurrent agents to mass-apply across various job sites, automating things like clicks and form-fills

I thought it was interesting, but would love to hear if you've thought of other quirky or unexpected use cases! :)

No formal benchmarks yet—but just from our own tests, OpenAI's computer use model has generally done a better job than Anthropic's, especially at locating the right click targets and coordinates. We're definitely planning a more thorough comparison soon, though! Curious if anyone else has noticed differences in these computer use models? Would love to swap notes! :)

Nice, excited to hear what you think! All feedback welcome :)

Yes, and yes!

Filling out forms is I think one of the biggest use cases for computer use agents. We're working on some stuff to specifically make that use case faster and more accurate

Regarding monitoring a specific inbox, and auto-responding, you could also set-up an agent to do that, but I would advise having the agent automate more formulaic/simple emails rather than having it use too much of its own judgement when writing the copy for these emails. You can also add in checks for the agent to check in before you before hitting send

Yep, we've also run into inconsistency issues when trying to build with these agents. The biggest thing we've seen help is by breaking the task down into smaller actions, effectively writing a script for the agent (e.g., go to google.com. type 'hello world', etc). The more loaded the prompt, the more off the rails it might go. We want to create more tools to help with reliability/this inconsistency, but it's also something that I hope improves relatively soon from the foundational model companies investing more here

In terms of multi agent workflows - it's something we've been thinking about! We especially think this could be especially helpful when filling out a form to speed things up even more. It's hard for me to think of other use cases though where multiple agents might need to share a vm (as opposed to just spinning up another vm with another agent), but curious to hear your thoughts!

Yes, agreed! We're planning on adding Claude as well as any other computer use models that pop up