News for hackers. Stuff that matters.
Re:Act-1: Transformer for Actions by aaaaaaaaaaab on Wednesday September 14, 2022 @04:55PM (#32843225)
What was the training data?
Re:Act-1: Transformer for Actions by version_five on Wednesday September 14, 2022 @05:09PM (#32843386)
Also, are there benchmark tasks that you either created or that already exist that you evaluated the model on?

PS - please don't let this me used at a way to prevent human interaction. Chatbots are a disaster and literally the worst possible application of ML, as a shitty interface to a menu system. I hope this will be used in a way that is not consumer-hostile and that the company actively resists ignorant business attempts to use it to avoid paying for customer support.

Re:Act-1: Transformer for Actions by tasdfqwer0897 on Wednesday September 14, 2022 @07:45PM (#32845044)
Yeah, we did have to custom-build our own benchmarks.

And we are not building a chatbot, we're building something collaborative that you can work with to accomplish the stuff you want to do!

Re:Act-1: Transformer for Actions by tasdfqwer0897 on Wednesday September 14, 2022 @05:12PM (#32843420)
We used a combination of human demonstrations and feedback data! You need custom software both to record the demonstrations and to represent the state of the Tool in a model-consumable way.
Re:Act-1: Transformer for Actions by elcomet on Wednesday September 14, 2022 @05:26PM (#32843612)
How many demonstrations were used ?

And was the feedback data used to train the model with reinforcement learning? Or did you request users to "correct" the action and get a supervised signal?

Re:Act-1: Transformer for Actions by angrais on Wednesday September 14, 2022 @05:47PM (#32843853)
How were the demonstrations annotated? Did you use annotations?