News for hackers. Stuff that matters.
Re:Classic Data science pipelines built with LLMs by erikgahner on Sunday February 09, 2025 @07:48AM (#42990350)
Most of these examples/walkthroughs look like they have been generated by LLMs. They might be useful for teaching purposes, but I believe they significantly underestimate the amount of domain knowledge that often goes into data extraction, data cleaning and data wrangling.
Re:Classic Data science pipelines built with LLMs by tsumnia on Sunday February 09, 2025 @08:09AM (#42990442)
I'm not against that approach (though I am a teacher so guilty as charged).

Toy examples help teach a concept and it helps when the example is relevant to the learner's interest. However at some point, we can't design real world application examples because so much additional mess has to get thrown in there. For example, a blog for learning web development isn't really useful to many but helps outline the basics of URL parameters, GET/POST requests, database management, etc.

It is on the learner to then take those skills and use them elsewhere. Or like it would do when I was learning, ignore the blog and make your own thing but roughly following the example.

Re:Classic Data science pipelines built with LLMs by galgia on Sunday February 09, 2025 @08:11AM (#42990455)
+ I assumed that most people will ctrl+a -> ctrl+c -> ChatGPT -> ctrl+v
Re:Classic Data science pipelines built with LLMs by tsumnia on Sunday February 09, 2025 @01:55PM (#42992699)
I will admit over reliance on AI is a major issue that we're coming to terms with right now. However to invoke playing devil's advocate, a person over relying on stimulants can also be a bad thing.

In moderation, AI can be fine and help. If you're assuming AI gets to do all the work while you sit around sipping mai tais and eating bonbons, you're going to have a rough time - which is exactly what we're starting to see with students that have been Copilot and GPTing through their classes. They're finally hitting the more complex stuff that needs creative thinking and problem solving skills that just aren't trained yet.

Re:Classic Data science pipelines built with LLMs by galgia on Sunday February 09, 2025 @07:54AM (#42990373)
You are right! This is here to be used when your resources do not allow you to build full-blow solutions. Yes, I used LLMs to help create examples from my existing code, but they are based on things I have put in production when the client's resources were limited and wanted to move from point 0 to test out the potential of LLMs on their data.
Re:Classic Data science pipelines built with LLMs by dkarl on Sunday February 09, 2025 @09:27AM (#42990877)
An LLM would need a lot of integrations to send the emails, Slack messages, and meeting invites to find out all the required domain knowledge. They're basically a full-fledged employee who could take on a management role at that point.