Classic Data science pipelines built with LLMs

Re:Classic Data science pipelines built with LLMs by galgia on Sunday February 09, 2025 @08:22AM (#42990510)

Yes, LLMs are not always the best option, they are an option. Sometimes requirements of the project are such that they are also the best option.

There is one browser that uses price matching example that is impossible to do without a full-blown data science team right now: https://github.com/Pravko-Solutions/FlashLearn/tree/main/exa...

[ Parent | on HN ]

Re:Classic Data science pipelines built with LLMs by timr on Sunday February 09, 2025 @08:27AM (#42990533)

Inappropriate tools are always an option? I can cut a cake with a jackhammer, but....

Anyway, like I said, there are certainly good applications of LLMs, and this is probably one? I wouldn't describe "do market research on prices" as a traditional "data pipeline", but that's just me, I guess.

[ Parent | on HN ]

Re:Classic Data science pipelines built with LLMs by daxfohl on Sunday February 09, 2025 @05:27PM (#42994725)

I think you'd tell the LLM to design the pipeline, not be the pipeline. That way you can see exactly what it's done and tweak as needed. Plus should be way more cost effective.

[ Parent | on HN ]