Re:Placing #1 in Advent of Code with GPT-3
by boppo1 on Sunday December 04, 2022 @04:17AM
(#33851958)
My question: how can you be sure the output is correct?
[ Parent
| on HN ]
Re:Placing #1 in Advent of Code with GPT-3
by OJFord on Sunday December 04, 2022 @04:32AM
(#33852030)
How can you be sure human output is correct?
Re:Placing #1 in Advent of Code with GPT-3
by fncivivue7 on Sunday December 04, 2022 @05:02AM
(#33852201)
Motivation.
Re:Placing #1 in Advent of Code with GPT-3
by greesil on Sunday December 04, 2022 @06:11AM
(#33852549)
Have the AI write a unit test for the human.
Re:Placing #1 in Advent of Code with GPT-3
by roflyear on Sunday December 04, 2022 @12:23PM
(#33855584)
I mean, you can't exactly say "AI, we're having this vague problem, can you go figure it out?"
Re:Placing #1 in Advent of Code with GPT-3
by demux on Sunday December 04, 2022 @05:08AM
(#33852232)
A few hours from some expert consultants. Much cheaper than a dev team coding it up from scratch.
Re:Placing #1 in Advent of Code with GPT-3
by kolinko on Sunday December 04, 2022 @07:06AM
(#33852913)
Tests.
Tests can prove the presence of the bug, not the absence of them. '100% code coverage' is only 100% in code dimension, while it's usually almost no coverage in data dimension. Generative testing can randomly probe the data dimension, hoping to find some bugs there. But 100% code and data coverage is unrealistic.
Re:Placing #1 in Advent of Code with GPT-3
by nerdponx on Sunday December 04, 2022 @09:54AM
(#33854181)
Training a machine learning model is not particularly special from a programming perspective. The code is not usually that complicated. Write tests when you can, manually validate when you can't.
Also there are specific techniques for validating that you are model training procedure is directionally correct, such as generating a simulated data set and training your model on that.
Re:Placing #1 in Advent of Code with GPT-3
by risyachka on Sunday December 04, 2022 @12:13PM
(#33855473)
All codebase will need to be covered in unit tests, otherwise AI code is pretty much useless I'd assume
Re:Placing #1 in Advent of Code with GPT-3
by fathrowaway12 on Sunday December 04, 2022 @04:02PM
(#33857848)
Same as you would with your own code. You review it, ask GPT to write tests, and then tweak it.
The difference is that now, you are more of a code reviewer and editor. You don't have to sit there and figure out the library interface and type out every single line.