News for hackers. Stuff that matters.
Re:Some argue that synthetic data can make AI systems better by csee on Friday February 18, 2022 @06:09PM (#30392423)
Not at all. The existence of the Gran Turismo game (a simulator) is not the same thing as an AI that can play Gran Turismo.
Re:Some argue that synthetic data can make AI systems better by stingraycharles on Friday February 18, 2022 @06:35PM (#30392677)
But a better analogy would be if an AI generated a computer game that another computer can learn to play.

In the end, it’s more like an anonymization layer than anything. If a computer is trained to generate input data for other computers to train with, there’s not a lot special going on.

Re:Some argue that synthetic data can make AI systems better by manmal on Friday February 18, 2022 @07:00PM (#30392901)
Generating an environment and acting within it are wildly different things. Eg Tesla generates virtual camera footage of traffic situations they want their vehicles to handle correctly. The footage generator is basically a scripted video game director, while the trained AI is one of the most complex software projects ever.
Re:Some argue that synthetic data can make AI systems better by csee on Friday February 18, 2022 @07:06PM (#30392944)

  "But a better analogy would be if an AI generated a computer game that another computer can learn to play."
Doesn't the latter AI have a policy which contains novel information that does not exist in the former AI?

Even if what you say is true in some abstract information theory sense (and I would question that), there is a world of practical difference in the usefulness of a trained self-driving AI and the game engine within which that AI functions.

Re:Some argue that synthetic data can make AI systems better by taeric on Saturday February 19, 2022 @12:23AM (#30394637)
But.... if you were to train a model on the simulator of the game, you would expect it to pick up on the rules programmed into the simulator.

This is really no different than it picking on the rules embedded in the data gathering of real world data. Any implicit and hidden decisions in that space would be expected to find their ways into the ML.

Re:Some argue that synthetic data can make AI systems better by redytedy on Saturday February 19, 2022 @01:15AM (#30394818)
The tricky part is that the simulator itself may not have easy to understand rules. Waymo has a Neurips talk about training world agent models that are used for car behavior in the simulation itself. Trying to make world agents that are indistinguishable from real-world vehicle behavior (e.g. minimizing jenson-shannon curvature entropy) is a completely different task than training a model to safely transport you somewhere.
Re:Some argue that synthetic data can make AI systems better by taeric on Saturday February 19, 2022 @11:10AM (#30398127)
Right. That was my angle. Sometimes, they are ready to see after the fact. But, just like bias can enter into data collection, so too can it enter simulation.
Re:Some argue that synthetic data can make AI systems better by csee on Saturday February 19, 2022 @03:05AM (#30395270)
Yes but isn't the optimal policy novel information?
Re:Some argue that synthetic data can make AI systems better by taeric on Saturday February 19, 2022 @11:10AM (#30398132)
But it's it free of bias and a good execution policy in the real world?
Re:Some argue that synthetic data can make AI systems better by csee on Saturday February 19, 2022 @01:37PM (#30399327)
That probably depends on how realistic the simulator is. Your trade off is more bias (due to simulation inaccuracy) in exchange for unlimited data (and hence less variance).
Re:Some argue that synthetic data can make AI systems better by taeric on Saturday February 19, 2022 @02:05PM (#30399570)
Agreed. I could see a good case of training heavily on simulated data, verify/validate on collected data.

My question is ultimately how this really helps with making the system ethical. Just moved the bias from collection to simulation. And... I can't see simulation being less impacted with bias.

Re:Some argue that synthetic data can make AI systems better by csee on Sunday February 20, 2022 @07:01AM (#30405060)
Ethical is not the right question here, we simply want it to crash less and kill less people
Re:Some argue that synthetic data can make AI systems better by taeric on Sunday February 20, 2022 @11:02AM (#30406676)
The headline of the article brings in ethics.