Show HN: ML-Dev-Bench – Benchmarking AI Agents on Real-World AI Workflows
https://github.com/ml-dev-bench/ml-dev-bench
We’re excited to share ML-Dev-Bench, a new open-source benchmark that tests AI agents on real-world ML development tasks. Unlike typical coding challenges or Kaggle-style competitions, our benchmark simulates end-to-end ML workflows including:- Dataset handling and preprocessing- Debugging model and code failures- Implementing new model architectures- Fine-tuning and improving existing...