Is the pytorch convention that one or zero should be used for mask values you do not want to attend to?
ChatGPT will give a correct answer and sample implementation, if the implementation is broken or uses a non resistant api then I just tell it what's wrong and ask it if it knows better. Getting to the correct answer has proven vastly more efficient than wading through google results.
Alternatively if I'm asking a conceptual question, chatgpt will give a few directions, I can ask to dive deeper on one, and then I ask it for a citation or google search terms to confirm the result. If I fail to confirm, I'll tell it that and see if it corrects.
If I have some code to write - and I'm feeling lazy. I can just tell chatgpt my requirements and ask it if it has any questions. I keep clarifying the questions until it says it can write the code ( which it usually does with 95% correctness for non trivial asks) - if you tell it where it made mistakes it will usually correct, and if not porting the code to a working state just means changing a few function calls which chat gpt hallucinated into existence.
I'm having trouble imaging how this could become ergonomic to use. Being able to CMD + T (new tab) and type a question right away just feels so easy and second nature at this point that I have trouble imagining replacing it
Example: Number of atoms in Universe
1. I get an answer from ChatGPT which comes more slowly than the Google one. Which I'm not sure is correct. I don't get any reference. 2. Google: I get the answer, plus links to various sources that contains also much more explanation in case I'm interested.
> I'm seeing fewer factual errors day by day.
How do you know there's a factual error, unless you also ask Google or know the answer before hand?