Re:Ask HN: Trouble learning things I view as solutions looki...
by Brian_K_White on Thursday July 11, 2024 @09:44PM
(#40942139)
"When each commit (or each RC etc) has automated regression testing"
This has a lot in common with old IBM batch processing essentially designed to consume rented resources.
Re:Ask HN: Trouble learning things I view as solutions looki...
by johnwatson11218 on Friday July 12, 2024 @09:54AM
(#40945592)
When the teams struggle to get a baseline suite working, adding k8s is not helpful.
When each commit (or each RC etc) has automated regression testing for output quality, performance, or XYZ metric critical for your business, the artifacts/reports from those code changes can be stored and audited when unexpected things happen during a release crunch.
We’ve had teams that shrugged off integrating with our CI tools, then a ”final” manual quality check on their release builds’ output showed significant regressions in completeness/accuracy. They scramble all their troops to run through the merged commits to find the culprit(s), and jeopardize delivery.
A basic CI setup could have posted perf/recall/whatever stats to their PR thread for each merged change, or better yet block the merge at some threshold for regressed metrics.
I definitely had the same view initially of CI, similar to unit test suites or verbose structured logging… things I viewed as complete overkill. What I learned was that these things DO still feel like overkill until the moment you really need the ability to reliably audit how each change affects an evolving large system