News for hackers. Stuff that matters.
Re:GPT-3.5 Turbo fine-tuning and API updates by SOLAR_FIELDS on Tuesday August 22, 2023 @09:37PM (#37230845)
As a counter reference, for my work I use it to code (for-4) and it has been between $70 and $200 per month depending on how heavily I use it
Re:GPT-3.5 Turbo fine-tuning and API updates by syntaxing on Tuesday August 22, 2023 @10:25PM (#37231190)
GPT-4 is significantly more expensive so I can definitely see you spending that amount. For really complex stuff, I switch over the GPT-4 and it will cost me almost $3 a "question" (as in going from the beginning to solving it). Honestly worth it since it solves my problem but it adds up quick so I try to stick with 3.5 when I can.
Re:GPT-3.5 Turbo fine-tuning and API updates by blorenz on Tuesday August 22, 2023 @10:57PM (#37231362)
Can’t you get by with ChatGPT-4 for these personal assistant type questions? That’s what I do and my 20 a month goes a long way. I’d be interested to see if I am missing out on anything using GPT to is way in contrast to the API.
Re:GPT-3.5 Turbo fine-tuning and API updates by SOLAR_FIELDS on Wednesday August 23, 2023 @12:52AM (#37232006)
I use it with a tool that is wired into my terminal that changes my files for me [1]. That alone makes me several times more productive compared to copy pasting back and forth between the chat window. If the chat window makes me twice as productive the command line tool probably makes me 5x as productive. At that kind of output on a developer salary the $70-200 a month is absolute peanuts compared to what you get in return

1: https://github.com/paul-gauthier/aider

Re:GPT-3.5 Turbo fine-tuning and API updates by Jach on Wednesday August 23, 2023 @01:06AM (#37232084)
Is your code subject to code review? If so have you done anything to improve that bottleneck, or was it never an issue at previous productivity?
Re:GPT-3.5 Turbo fine-tuning and API updates by SOLAR_FIELDS on Wednesday August 23, 2023 @12:06PM (#37238164)
It is subject to code review, but I typically spent much more time writing code than having it reviewed (I am very methodical and slow writing code)
Re:GPT-3.5 Turbo fine-tuning and API updates by blorenz on Thursday August 24, 2023 @08:23AM (#37247963)
This tool looks splendid. Personally, it evokes in me the memories of MUDding back in the early 90s. What a concept that would be to MUD to build apps via LLM -- or even MUD to build the MUD in real-time outside of the OLC and scripting. That sounds like a passion project for me when I can find the time.
Re:GPT-3.5 Turbo fine-tuning and API updates by syntaxing on Wednesday August 23, 2023 @07:14AM (#37234178)
I actually used to use ChatGPT but switched to the API once I had GPT-4 access. Mainly it’s because I simply didn’t use the $20 worth of the GPT-4 at the time. It was extremely slow and the question per hour limitation was annoying and stressful. I would always worry I would need it for something unexpected so I never used more than 15 questions at a time (but this has probably changed these couple months). In addition, the privacy implications are better for the API since the terms are better for how they handle your data. I also like how I can tie in GPT anywhere. I use the matrix bridge so you can give access to people like my parents who are not as tech literate to sign up and get used to chatgpt interface. I allow them to talk to it as a bot through WhatsApp bridge.