Re:OpenAI Codex
by karmasimida on Tuesday August 10, 2021 @03:48PM
(#28133363)
It is simultaneously impressive and underwhelming for me.
I mean yes this is a super impressive demo, but it didn't go beyond my expectation. I really want to see whether this model can write a correct binary search method without seeing one before.
Or even correctly using the binary search, does it understand concept like index boundaries?
> I really want to see whether this model can write a correct binary search method without seeing one before.
It has almost definitely seen a lot of coding problems so I would expect "write a function to binary search a sorted array" to output the intended result. I don't think anybody expects it to come up with algorithms it hasn't encountered.
I found the whole UI/sandbox they created the most interesting part. Now don't get me wrong, the tech is certainly great and all, but I really didn't had the feeling I watched/learned more than I already knew from what was shown with Github CoPilot, although I was kinda impressed, if it really is as simple as they stated, at how it is able to adapt to new apis.
It's a shame they only limited the demo to relatively simple instructions.
> I really want to see whether this model can write a correct binary search method without seeing one before.
I don't believe the model was trained on Google interview answers, sadly.
aaaand they've blocked audio until 18:17ish, timestamp url: https://www.twitch.tv/videos/1114111652?t=00h18m17s
https://www.twitch.tv/videos/1114111652
Starts at 15:45.