Re:Searchformer: Beyond a* Better Planning with Transformers...
by radomir_cernoch on Saturday April 27, 2024 @06:32AM
(#40178875)
I'd love to read more. Do you know any sources?
Re:Searchformer: Beyond a* Better Planning with Transformers...
by algo_trader on Saturday April 27, 2024 @09:24AM
(#40179783)
Try Reinforcement Learning for Combinatorial Optimization: A Survey
or a more recent and spirited discussion on reddit..
https://old.reddit.com/r/reinforcementlearning/comments/196i...
Re:Searchformer: Beyond a* Better Planning with Transformers...
by nickpsecurity on Saturday April 27, 2024 @01:35PM
(#40181822)
Link for those who need it:
Re:Searchformer: Beyond a* Better Planning with Transformers...
by davidguetta on Saturday April 27, 2024 @08:49AM
(#40179550)
Mm theres one purely based on position analysis and not tree search that has GM level in chess. From deepmind
Re:Searchformer: Beyond a* Better Planning with Transformers...
by lou1306 on Saturday April 27, 2024 @10:39AM
(#40180297)
SAT appears to be rather impervious to statistical methods because it is very non-linear and non-local (besides, of course, being NP-complete). Flip one single literal anywhere and poof!, your formula mght go from SAT to UNSAT, or vice versa, or you might enable a ton of simplifications, etc. So it might be very hard to train a network on such a riotous state space.
Additionally, in practice SAT solvers are also supposed to provide witnesses (i.e., a satisfying assignment or an unsatisfiability core) to back their verdicts, and that may be an ever taller order for ML.
Re:Searchformer: Beyond a* Better Planning with Transformers...
by math_dandy on Saturday April 27, 2024 @01:05PM
(#40181574)
Since all of these combinatorial optimization problems are, in full generality, are as difficult as possible in the complexity theoretic sense, there is little prospect of AI/ML helping to solve these problems in general. (?)
But people hope that some subclass of "real-life" instances of one of these optimization problems has enough structure that AI/ML may be able to learn useful heuristics for it. (This is not my field. This is just my take-away from reading some AI/ML-for-CO papers.)
IIRC, they were unable to exceed Sota of SAT solvers (which admittedly are the results of decades of research)
maybe we just needed bigger networks, or transformers, or just more training compute