News for hackers. Stuff that matters.
Re:Replacing a SQL analyst with 26 recursive GPT prompts by kvh on Wednesday January 25, 2023 @06:12PM (#34525490)
Author here, I’ve updated the post. The first draft of this app and blog post took me two hours, but I kept coming back with new ideas and tweaks throughout the week. By the end, I’d certainly spent more than two hours (more like 8?), so you’re right, I just failed to update the post. The main point stands — it’s surprisingly good for the amount of effort put in (although unclear how much more juice you could get out of gpt with more effort. Clear diminishing returns)
Re:Replacing a SQL analyst with 26 recursive GPT prompts by xwolfi on Wednesday January 25, 2023 @07:21PM (#34526167)
Can we replace a webmaster with 26 chatgpt prompts?
Re:Replacing a SQL analyst with 26 recursive GPT prompts by OOPMan on Wednesday January 25, 2023 @08:22PM (#34526606)
I reckon we can replace a shill with less
Re:Replacing a SQL analyst with 26 recursive GPT prompts by devmor on Wednesday January 25, 2023 @08:58PM (#34526829)
It doesn't seem like you've really replaced anyone with this. You spent 8 hours doing the work that you could have paid an SQL analyst to do in much less.

Unless you're saying that your time is worth less than you'd pay the analyst?

Re:Replacing a SQL analyst with 26 recursive GPT prompts by antihipocrat on Wednesday January 25, 2023 @09:34PM (#34527074)
I think the idea is that once built it would be a service that could parse a question, then automatically develop and run any query in response.

Sounds cool until it produces the wrong results.. then you'll need to hire an analyst to check every query just in case.

Re:Replacing a SQL analyst with 26 recursive GPT prompts by kqr on Thursday January 26, 2023 @12:51AM (#34528126)
As if the analyst doesn't get the results wrong! For 1/50 of the price, maybe a few more errors are acceptable, even.
Re:Replacing a SQL analyst with 26 recursive GPT prompts by desert_rue on Thursday January 26, 2023 @01:08AM (#34528206)
Which errors are you okay with?
Re:Replacing a SQL analyst with 26 recursive GPT prompts by kqr on Thursday January 26, 2023 @03:06AM (#34529023)
The ones for which I would refer the question to GPT. We are still in control of which questions go to GPT/the intern analyst (less critical ones, where a fraction erroneous are okay) and which go to the resident expert analyst.
Re:Replacing a SQL analyst with 26 recursive GPT prompts by stkni on Thursday January 26, 2023 @08:36AM (#34531426)
This is a good point. If the users know the difference the costs and benefits between using GPT and not using it then it certainly has value if those users are also willing to accept that not every answer needs to be 100% accurate.

In my experience business people often have a 'nose' for the right number and will bluff it out if the numbers are wrong and they're challenged.

Blue sky things or stuff you're putting in the annual report should be left to hoomans IMHO.

Re:Replacing a SQL analyst with 26 recursive GPT prompts by gampleman on Thursday January 26, 2023 @08:49AM (#34531536)
Also it could possibly remove the (dreaded) on call aspect of it.

I think a lot of business owners would be relatively happy with automated instant answers, or get carefully considered answers in a week.

Re:Replacing a SQL analyst with 26 recursive GPT prompts by shinycode on Thursday January 26, 2023 @03:08AM (#34529031)
Yeah and whose responsibility is it when not catched in time and there this consequences / damage ?
Re:Replacing a SQL analyst with 26 recursive GPT prompts by kqr on Thursday January 26, 2023 @09:31AM (#34531995)
The consequences would be accounted for up front and paid out of the savings from using GPT.
Re:Replacing a SQL analyst with 26 recursive GPT prompts by shinycode on Thursday January 26, 2023 @03:57PM (#34538720)
Which price tag are you willing to put on a loved one’s life ? Some consequences of fully automated systems can go deep into human life cost.
Re:Replacing a SQL analyst with 26 recursive GPT prompts by guru4consulting on Thursday January 26, 2023 @09:50AM (#34532269)
If there are extensive test cases with static dataset, this may help with query modifications (optimize query, fine-tune, etc.) Of course, this may not feasible for new queries as you can't have test script until the query is ready.
Re:Replacing a SQL analyst with 26 recursive GPT prompts by skissane on Thursday January 26, 2023 @04:13PM (#34538935)
Put the requests in a queue. Have the bot generate the response. Then forward the response to a human analyst to double-check. A human can surely double-check a response much faster than they can produce one from scratch.

In many professions, it is common to have junior staff members do the grunt work, and then the more senior staff just review their work and either sign off on it, correct it, or send it back to be redone. You could use the same pattern here, replacing the junior staff with an AI, but keeping the senior one.

Re:Replacing a SQL analyst with 26 recursive GPT prompts by jhugo on Wednesday January 25, 2023 @09:17PM (#34526948)
They built a bot which can answer any number of questions, each of which would have needed some analyst time. Given that the analyst rotation was an entire day once every N weeks, and the bot took 1 day to make, this is going to pay for itself after 1 week.

This all assumes that the bot doesn't need tweaking for every answer — i.e. it gets at least some answers right without needing modifications to the bot — which appears to be the case based on the examples in the post.

Re:Replacing a SQL analyst with 26 recursive GPT prompts by freejazz on Wednesday January 25, 2023 @10:53PM (#34527490)
But, generally and unless there is a glaringly wrong result, only an analyst is going to know if the bot is right or not... what exactly does that gain you?
Re:Replacing a SQL analyst with 26 recursive GPT prompts by catothedev on Wednesday January 25, 2023 @10:58PM (#34527518)
It gets you a really sophisticated 'auto-complete' feature
Re:Replacing a SQL analyst with 26 recursive GPT prompts by freejazz on Wednesday January 25, 2023 @11:23PM (#34527658)
Not really. I'd guess that most people can tell if auto-complete is providing the answer they "wanted".
Re:Replacing a SQL analyst with 26 recursive GPT prompts by kqr on Thursday January 26, 2023 @12:53AM (#34528135)
Maybe it's not a position where it is critical that all answers are 100 % accurate. Maybe getting it right every once in a while is enough to pay for the GPT compute time, but not really for analyst time.
Re:Replacing a SQL analyst with 26 recursive GPT prompts by anentropic on Thursday January 26, 2023 @05:37AM (#34530051)
Seems like the issue would be you'd generally get results that 'look' right but would never know if they were actually right without going through and... analysing them
Re:Replacing a SQL analyst with 26 recursive GPT prompts by kqr on Thursday January 26, 2023 @09:29AM (#34531970)
I'm saying there are applications where you don't have to know! As long as the fraction incorrect is less than 50 % and you have 2:1 odds on the consequences you don't have to know which 50 % are incorrect.
Re:Replacing a SQL analyst with 26 recursive GPT prompts by freejazz on Thursday January 26, 2023 @10:10AM (#34532562)
Really? Then why pay for the thing in the first place. Why keep the data and make the queries if the results don't actually matter? I'm impressed that you have the ability to envision such a possibility, perhaps you can use that ability to come up with something reasonably likely as opposed to "conceptually possible".
Re:Replacing a SQL analyst with 26 recursive GPT prompts by kqr on Thursday January 26, 2023 @10:59AM (#34533400)
I'm trying to think of easy examples. You're right that none obvious come to mind. I'm sure there is a sweetspot where we can make more money from cheap-but-sometimes-wrong GPT queries than paying for an analyst to be more definitively correct, but I'm tired and a bit fuzzy on the exact parameters.

I'll continue to think about it and write something up!

Re:Replacing a SQL analyst with 26 recursive GPT prompts by freejazz on Thursday January 26, 2023 @12:07PM (#34534627)
Hard to imagine a business model where you sell that data that is only right 60% of the time. Maybe in a world where the other best data is even less reliable.
Re:Replacing a SQL analyst with 26 recursive GPT prompts by moonchrome on Thursday January 26, 2023 @08:04AM (#34531138)
If you're OK with garbage data you don't need ChatGPT - you can probably make up plausible data on your own. Unless you're building some lorem ipsum stuff.
Re:Replacing a SQL analyst with 26 recursive GPT prompts by kqr on Thursday January 26, 2023 @09:33AM (#34532015)
I might not be okay with only garbage data, but data that are correct 60 % of the time may be good enough for some use cases, when it can be had for 1/50 of the price.
Re:Replacing a SQL analyst with 26 recursive GPT prompts by freejazz on Thursday January 26, 2023 @10:11AM (#34532592)
Then posit such a scenario as opposed to just the numbers...
Re:Replacing a SQL analyst with 26 recursive GPT prompts by stevenally on Wednesday January 25, 2023 @09:24PM (#34527005)
Couldn’t you have just got ChatGPT to write the post?
Re:Replacing a SQL analyst with 26 recursive GPT prompts by mdcox on Wednesday January 25, 2023 @10:45PM (#34527448)
no one wants to automate themselves out of a job, only other people.
Re:Replacing a SQL analyst with 26 recursive GPT prompts by tw1984 on Thursday January 26, 2023 @02:06AM (#34528572)
gold. very deep insight into the human nature.

;)

Re:Replacing a SQL analyst with 26 recursive GPT prompts by banku_brougham on Thursday January 26, 2023 @02:40AM (#34528816)
I am trying to automate my job away, but i'm not succeeding.
Re:Replacing a SQL analyst with 26 recursive GPT prompts by blowski on Thursday January 26, 2023 @03:59AM (#34529356)
We all believe our job is so challenging and has such special requirements that it _can't_ be automated. It requires someone with the kind of experience learned with wisdom over a long time. Blah blah blah.
Re:Replacing a SQL analyst with 26 recursive GPT prompts by foobarbecue on Thursday January 26, 2023 @09:29AM (#34531976)
Not all of us.
Re:Replacing a SQL analyst with 26 recursive GPT prompts by tremon on Thursday January 26, 2023 @04:53PM (#34539421)
Except for the ones of us who keep automating our jobs so that we can spend our effort on more challenging tasks.
Re:Replacing a SQL analyst with 26 recursive GPT prompts by Hellmitioksldf on Thursday January 26, 2023 @04:15AM (#34529458)
Thats actually my strategy;

This makes it so that 1. my quality overall becomes better and my bosses always liked that (doing things per hand are more error prone, not on time etc.)

2. I can go on holiday knowing my company doesn't need me desperate

3. I can spend the free time of actually innovating and bringing more value to the company/product

The problem is not automating yourself out of a job but not being able to leverage the new gained capacity.

Re:Replacing a SQL analyst with 26 recursive GPT prompts by Hedepig on Thursday January 26, 2023 @04:26AM (#34529525)
Despite productivity generally improving over the last few decades, wage compensation has not.

I'm concerned this will continue as a trend with any productivity improvements from these models.

Re:Replacing a SQL analyst with 26 recursive GPT prompts by foobarbecue on Thursday January 26, 2023 @09:46AM (#34532212)
Right. Presented with efficiency gains, firms tend to increase profit, not wages. One way to change that is to give workers more bargaining power through market shifts or unionization.
Re:Replacing a SQL analyst with 26 recursive GPT prompts by sumitkumar on Friday January 27, 2023 @03:02AM (#34543754)
All the productivity gains are first transferred to the consumer(because of market dynamics) and then(by the market winners) to shareholders. The workers' wage market is not related to productivity but how the company is internally organized is linked to productivity.
Re:Replacing a SQL analyst with 26 recursive GPT prompts by Hellmitioksldf on Monday February 06, 2023 @07:46AM (#34676538)
My way helped me succeed. I took my skills and my achievements (which i made in my R&D Time) to another company and got more money and than i did it again and got more money again.
Re:Replacing a SQL analyst with 26 recursive GPT prompts by foobarbecue on Thursday January 26, 2023 @09:29AM (#34531967)
I totally automate my roles on projects all the time so I can move on to more interesting things. I guess you mean that no one wants to be fired, but I don't see how that can result from automating one's work.

Also, I HATE doing repetitive things. Some people seem to like it though. To each their own, I guess. Reminds me of https://youtu.be/wNVLOuQNgpo