Re:Classic Data science pipelines built with LLMs
by galgia on Sunday February 09, 2025 @07:56AM
(#42990378)
I see it as a gray area - long term there will be a need for both and you will have just one tool to choose from when presented with time-budget-quality constraints.
[ Parent
| on HN ]
Re:Classic Data science pipelines built with LLMs
by miningape on Sunday February 09, 2025 @08:01AM
(#42990402)
Yeah I can also see it very much depending on the demands - I'm definitely not saying every pipeline has to be the most reliable, scalable piece of software ever written.
If a small script works for you and your use case / constraints there's nothing I can say against it, but when you do grow past a certain point you'll need pipelines built in a proper way. This is where I see the increased demand since the scrappy pipelines are already proving their value.