Examples I can think of where it gave wrong info was:
- I asked to compare the size of the MacBook m1 and the 16" framework laptops
- I asked how to add the nixpgs-unstable channel in NixOS.
- I asked to help write a power shell script to create AD accounts.
The first one is open ended and I don't think M1 came before the "cut date of knowledge" in chatgtp. The 2nd one is too niche, likely not enough data to grab.
For the 3rd one, I don't know if the "date of knowledge cut" isn't recent enough - powershell became a thingy more recently and isn't wide adopted.. but I would expect to be a good fit
Claude Instant will not give you the highest quality answers.
It's like if an alien visited and the first place they went was to a convention for Special Needs people and then they decided that humans were too stupid to talk to. Or rather, there was a Mensa convention next door with a $20 entrance fee and they figured it wasn't worth it.
Or rather, for $20 everyone at the Mensa convention agreed to log in to a special app and wait 24/7 for any time you have a question. Then they would instantly select the most knowledgeable among them in that subject and immediately enter a reply incredibly quickly.
It’s written at least 20 python scripts with me and almost all of them have been close to perfect almost on first draft.