News for hackers. Stuff that matters.
Re:Classic Data science pipelines built with LLMs by galgia on Sunday February 09, 2025 @07:56AM (#42990378)
I see it as a gray area - long term there will be a need for both and you will have just one tool to choose from when presented with time-budget-quality constraints.
Re:Classic Data science pipelines built with LLMs by miningape on Sunday February 09, 2025 @08:01AM (#42990402)
Yeah I can also see it very much depending on the demands - I'm definitely not saying every pipeline has to be the most reliable, scalable piece of software ever written.

If a small script works for you and your use case / constraints there's nothing I can say against it, but when you do grow past a certain point you'll need pipelines built in a proper way. This is where I see the increased demand since the scrappy pipelines are already proving their value.

Re:Classic Data science pipelines built with LLMs by galgia on Sunday February 09, 2025 @08:48AM (#42990658)
Exactly, scale after you need to.