kotama7

I agree that many of the improvements found by auto-research systems could probably be discovered more efficiently by properly parameterized Bayesian optimization. Still, I think LLM-based heuristic guesses can be useful in some cases, especially for proposing reasonable initial hyperparameters based on prior knowledge reported on the web and in blog posts.