News for hackers. Stuff that matters.
Re:Coping with Copilot by zitterbewegung on Saturday August 20, 2022 @11:11AM (#32532591)
Just add a requirement where the student has to explain how the code works.

To be honest there should be a class called language model querying because for simple tasks it does well but eventually you will have to debug the output (not just copilot but GPT3 and dall-e).

Re:Coping with Copilot by GrumpyYoungMan on Saturday August 20, 2022 @11:26AM (#32532716)
Much like reverse engineering, it's easier to come up with an explanation when you have someone else's working solution to examine than it is to come up with a working solution from scratch on your own. So that doesn't really help.
Re:Coping with Copilot by vinodkd on Saturday August 20, 2022 @12:34PM (#32533271)
but maybe, they'll end up learning anyway? one thing i realized when i went back to studying online is that i was no longer the student who needed to prove something to someone else, and the typical test annoyed me. I get that this article is about a teacher trying to find out how much their students have learned a subject, but maybe that needs to change?
Re:Coping with Copilot by niek_pas on Saturday August 20, 2022 @11:28AM (#32532727)
Agreed, and, in addition, having every single student explain their program would be a significant burden on teaching resources.
Re:Coping with Copilot by emeryberger on Sunday August 21, 2022 @12:37PM (#32541820)
Article author here. Turns out language models already can explain how code works, pretty convincingly. I gave a prompt to OpenAI, got the solution, and then asked it to explain the solution (possibly easier to read in my tweet: everything in green below is from OpenAI - https://twitter.com/emeryberger/status/1560618825208320001). I wrote the comment asking a question ("# How did you solve this problem? Explain how you got each digit from each number.") and Tab completed the rest:

  # I solved this problem by using the % operator to get each digit from the number. I declared and initialized a sum variable to keep track of the sum of the digits of the number. I set a temp variable equal to the input number. I then used a while loop to loop through each digit of the number. In the loop, I used the % operator to get the remainder of temp divided by 10. This gave me the last digit of the number. I added this digit to the sum variable. I then divided temp by 10 to remove the last digit of the number. I repeated these steps until all of the digits of the number were added to the sum variable. Finally, I printed the value of the sum variable.
Re:Coping with Copilot by wiradikusuma on Saturday August 20, 2022 @11:15AM (#32532616)
> Just add a requirement where the student has to explain how the code works.

There's an AI for that!

Re:Coping with Copilot by jefftk on Saturday August 20, 2022 @11:23AM (#32532683)
> there should be a class called language model querying

Do you think the skills taught in that class would be relevant for very long?

Re:Coping with Copilot by zitterbewegung on Saturday August 20, 2022 @11:26AM (#32532715)
Hypothetically if they became irrelevant wouldn't that imply that we have models that could just understand natural language?
Re:Coping with Copilot by jefftk on Saturday August 20, 2022 @11:31AM (#32532753)
Not necessarily. The skills could become irrelevant just because the models advance and you need new and different skills to query them effectively.
Re:Coping with Copilot by zitterbewegung on Saturday August 20, 2022 @12:13PM (#32533096)
But then you would have a foundation to figure out the new models. This is the essential problem when teaching any field because the field itself advances faster than one can effectively teach you.

That's why getting an Internship is always a good idea.