I interview remotely. The long pauses that get longer as the questions go from superficial to "you need to have done this for a while to know" are frustrating and obvious but also a great indicator if what is going on.
I always ask "what is happening during the long pauses". No one yet has said " I'm thinking". That's probably because I have always said going in "if you need time to think, or don't know, we can just talk about your thought process; noone knows everything and we all learn as we go". So a non-threatening out exists.
Only happened a few times.
Last time I had a senior dev on the call typing in the questions to chatgpt as we went and he was getting the same answers as the candidate with points in the same order. Some of these were wrong in very specific ways.
On some of the assignments we gave out we would provide a set of, say, 10 initial test cases that the students could use to verify their work with the expectation that they would write more of their own. As a marking team we would also generate our own more detailed test suite; partly to make our job easier, partly to try to identify trends of places where students might not be understanding the course material. That ended up being another interesting way to identify plagiarism: if only 2 or 3 assignments failed a given unit test we would go and look to see if the implementations on those assignments was identical…
But think about what computers were like when they first hit the market. What about the first year of public internet? Or the first generation of cellphones. These technologies also had major issues and shortcomings that would, if not improved, severely limit their usefulness.
Nobody knows what AI will be like in 5 to 10 years with the burst of investment and focus that this past year has ensured.
OpenAI is valued at $100b or something and given the hype I would have thought that it would have solved basic knowledge economy things like spreadsheet analysis, something that millions of well-compensated people are currently employed to do.
Why is there no "AI Excel" that can take a 1GB CSV and answer questions that are one step more complex than Pivot Tables?
As a business user, I don't care about AI that pretends to 'talk' like a human and 'draws' pictures. I need it to be able to do the work of a securities analyst.
Not sure what file size limit is but chatgpt can do this.
The question is whether AI's limitations are more like too I/O limited, too slow, not enough storage, or more like fundamental things like GIGO and (virtually) all software having bugs and people having to handle that.
We don't know what and how LLM will impact the future.
A backup communication system in case the Soviets took out the phone system? What's non-positive about that?
I mean, telling the majority of the population that hey, you don't have secret knowledge, now you are mostly worthless is a completely foreseeable rearrangement of the economy, at least in the sense the rearrangement is coming. The question of how the new arrangement will look is unpredictable and likely spans anywhere from UBI to guillotines.
Software engineers collectively are 2.54% of the total USA workforce; the only time I've used YACC was at university, and given what it does I have to assume that (despite the large number of languages out there) YACC knowledge is relatively niche… and it's something ChatGPT "knows".
It might not be reliable enough (yay, I still get to be paid for my existing skills!), but I think it absolutely does have niche knowledge.
You can (or at least could before ChatGPT) definitely get a job just by knowing yacc, aria, Kubernetes, etc. which are certainly niche subjects. But you get a very high-paying job knowing how to write highly-optimized code for a specific type of hardware, how to implement a cutting-edge algorithm in <insert language>, how to integrate a badly-documented library filled with edge cases, or how to satisfy legal/government requirements. These are jobs which rely primarily on knowledge, and a tiny bit of putting pieces of knowledge together.
Surface-level knowledge (which ChatGPT is good at) was already accessible by anyone who can do basic research, albeit slower. It wasn't a gated skill, so I can imagine some people achieved decent jobs from it, but most managers probably either did it themselves or assigned it to someone with a different job.