News for hackers. Stuff that matters.

A comment on BioGPT: A Language Model Pre-Trained on Large-Scale Biomedical Literature. Parent comment

Re:BioGPT: A Language Model Pre-Trained on Large-Scale Biome... by FeepingCreature on Wednesday February 01, 2023 @11:09AM (#34612501)
If you wanted to hire people to multiply numbers, it would be very worthwhile to test the functioning of the hardcoded multiplication table, or whatever other implementation they had.

Nobody is saying that GPT-3 is smart. But it is surprisingly capable.

[ Parent | on HN ]
Re:BioGPT: A Language Model Pre-Trained on Large-Scale Biome... by beepbooptheory on Wednesday February 01, 2023 @11:17AM (#34612680)
Right, and again, if there was some virtue to passing a test in itself, I would be on board. But a test for a human is meant to show something about the human that isnt just their test taking abilities. But with GPT we can only ever say that it has good human test taking abilities. Again, I know people are excited, and they have reason to be, but you gotta adjust your mindset here a little or you will end up in a weird B.F. Skinner logic hole.
[ Parent | on HN ]