News for hackers. Stuff that matters.

A comment on GPT-4 and professional benchmarks: the wrong answer to the wrong question. Parent comment

Re:GPT-4 and professional benchmarks: the wrong answer to th... by pixl97 on Tuesday March 21, 2023 @12:31PM (#35248566)
>If you don't understand it don't check it in.

I work in code security, and after helping any number of customers, I can tell you this isn't how far too many programmers work.

A client recently had a problem with a project that had over 1200 node_modules.

1200...

Let that sink in. There is absolutely no way in hell they even had any idea about a small portion of the code they were including.

[ Parent | on HN ]
Re:GPT-4 and professional benchmarks: the wrong answer to th... by com2kid on Tuesday March 21, 2023 @01:08PM (#35249178)
> A client recently had a problem with a project that had over 1200 node_modules.

# of Node modules is such a useless metric.

In any given project, a large # of node modules are part of the test, build, and linting frameworks.

If I go to C++ land and count the number of #import statements, it wouldn't tell me anything.

How many classes do large Java projects use? Typically some absurd number.

[ Parent | on HN ]
Re:GPT-4 and professional benchmarks: the wrong answer to th... by teaearlgraycold on Tuesday March 21, 2023 @01:18PM (#35249323)
Are those direct dependencies or the full dependency tree?
[ Parent | on HN ]