Indeed, I've used it as you describe as well. I particularly like giving it the specs and asking for the docs though, because it's a humbling experience for ChatGPT. Or, I should say it makes its abilities and limitations apparent.

When I'm dealing with my own project, I know everything about it. That means there's no room for ChatGPT to correct me. So when it starts telling me what my project can do that I know it can't, I know when it's bullshitting.

I also wrote the docs myself, so I can see where it's using key phrases and words that I've fed it. This makes it clear to me that to a large degree it's paraphrasing what I've already told it.

I can also ask it to make inferences about my project, but it won't go far beyond they boundaries of the information I've given it. It will expand upon them, but it won't make the same kinds of long-range connections that say, a junior college student can make, unless you explicitly start prompting it to make those connections.

But it's also surprising in many ways. For instance, I gave it a bunch of features of my project, and then I asked it why my project is fast. It gave me back a subset of the features which are related to performance, but it wasn't able to come up with any novel reasons I hadn't supplied before.

In all, I'm really impressed by it, but my feeling after using it extensively is that currently it won't be replacing any experts soon. It will, however, empower them to a degree where they can expand their own abilities. For me, I've been feeling the limitations of my abilities as a solo dev working on a massive project alone. I've been thinking about raising money and hiring people to help me. Now all of a sudden, there will be no money raised in the near term, and there will be no job opening posted. No one lost a job as a result of this, but someone will be going without work they might have had otherwise, because now I'm more capable than I was yesterday. That's how this will play out in the long term, I imagine at companies around the world: more work for fewer people, higher heights achieved, the rich get richer, the poor get poorer. If you're not baseline competitive with ChatGPT, I'm not hiring you. You've got to be better than it now.

In that sense, ChatGPT will change everything, but nothing will be different.

This is a really balanced take as against the GPT revolution hype train who really seem to be underestimating the expertise behind the value of the prompt.

Meaning asking good questions (prompting) requires a certain degree of skill and those who do not have it will derive no more value from GPT (and it's variants) than they would from using traditional search.

In essence, the expert gets more done.

You two should hang out