Re:Ask HN: SWEs how do you future-proof your career in light...
by sky2224 on Tuesday December 17, 2024 @03:55AM
(#42439628)
> LLMs can pass CFA III
I don't think this is that big of a deal. It's essentially just statistics surrounding text completion scaled up to a massive level. I'd wager that any CFA III questions that involved more complex logic and/or numbers were done poorly by whatever LLM was being evaluated (unless of course the LLM had been trained on the exact test that it was taking, which in that case, it's just cheating).
Code isn't about text completions, it's about logic. Throw anything that isn't boilerplate CRUD or UI and an LLM will not function without hand holding at the very least.
You're right though, the job will change, and honestly I think it will get more fun. A lot of that boilerplate code that's always a drag to do will be easy to setup very quickly. Engineers will get more opportunity to dive into the meat of the problems they're solving instead of spending time building scaffolding that they've done 1000s of times.
I don't think this is that big of a deal. It's essentially just statistics surrounding text completion scaled up to a massive level. I'd wager that any CFA III questions that involved more complex logic and/or numbers were done poorly by whatever LLM was being evaluated (unless of course the LLM had been trained on the exact test that it was taking, which in that case, it's just cheating).
Code isn't about text completions, it's about logic. Throw anything that isn't boilerplate CRUD or UI and an LLM will not function without hand holding at the very least.
You're right though, the job will change, and honestly I think it will get more fun. A lot of that boilerplate code that's always a drag to do will be easy to setup very quickly. Engineers will get more opportunity to dive into the meat of the problems they're solving instead of spending time building scaffolding that they've done 1000s of times.