More like: the accessibility is what will make it go around. The accessibility is what changes everything! Getting an easy to use interface (instructions) over python changes the accessibility from the denizens of this website to ~anyone with a computer
If you're interested, see this paper that argues that point: https://arxiv.org/abs/2302.06541
Essentially, being label efficient is more important than being compute efficient, because the biggest computing constraint we have is enough humans doing the labeling (and knowing how to work a jupyter notebook), not tensor smashing nvidia cards
Re: https://arxiv.org/abs/2302.06541 - how are we supposed to take the phrase "agile text classification" seriously?
They could have just said "efficient". But no - they had to go for "agile".
Re:The Coming of Local LLMs
by travisjungroth on Tuesday April 11, 2023 @12:11PM
(#35527209)
Ease of use is huge, so is deployment. Even as a software engineer the overhead for a random classification is so much lower.
Re:The Coming of Local LLMs
by londons_explore on Tuesday April 11, 2023 @12:10PM
(#35527190)
I think the real benefits will be for those with an ad-hoc task and no programming/scripting ability.
Sure, you and I know how to write a little script to sort a directory of documents into "schoolwork" and "other stuff".
But most people don't have that ability, so giving them that would really help accessibility.
Ease of use is what is going to change everything. Using natural language to ask something and getting an answer is different from what we had before. I knew I could automate a lot of my paperwork with scripts but as I am not a programer I never gave it more than a cursory look. Last Dec while playing around with ChatGPT I was able to get it to write some python scripts that resulted in my spending less than 20-25 min on tasks that I was spending 20-25 hours on. Now could I have written the scripts myself probably but it would have taken me months whereas with chat gpt it took me 2-3 hours to get a working scripts and another 1-2 hours to optimise them.
Maybe both the buzz factor and broader applicability means it's more likely to happen this go around?