News for hackers. Stuff that matters.

A comment on Microgpt. Parent comment

Re:Microgpt by krisoft on Sunday March 01, 2026 @07:19AM (#47206045)
> Astute readers will note what’s been missed here.

I’m not astute enough to see what was missed here. Could you explain?

[ Parent | on HN ]
Re:Microgpt by Otterly99 on Monday March 02, 2026 @07:44AM (#47217310)
If I'm not mistaken, BERT is a classifier (enters text, outputs labels) so it is not a "Language model", as it cannot be used for text generation.
[ Parent | on HN ]
Re:Microgpt by krisoft on Monday March 02, 2026 @12:10PM (#47220819)
The abstract of the original BERT paper starts with these words: "We introduce a new language representation model called BERT, [...]" The paper itself contains the phrase "language model" 24 times.

It might not be considered a language model today, but it was certainly considered one when it was originally published. Or so it would seem to me. Maybe there is a semantic shift which happened here?

[ Parent | on HN ]