News for hackers. Stuff that matters.
Re:We Found an Neuron in GPT-2 by edgyquant on Thursday February 16, 2023 @05:54PM (#34827787)
I is a vowel so your rule about sound doesn’t apply here. It’s also not a rule I’ve ever heard, in school we’re taught that only vowels get a before them
Re:We Found an Neuron in GPT-2 by fragmede on Thursday February 16, 2023 @06:17PM (#34828118)
Re:We Found an Neuron in GPT-2 by jmpman on Thursday February 16, 2023 @10:44PM (#34830466)
Thank you for posting this. I’m always surprised when people claim the rule is based upon the immediate letter instead of the pronunciation of the first syllable. Makes me wonder if the model was trained incorrectly.
Re:We Found an Neuron in GPT-2 by frogulis on Thursday February 16, 2023 @06:14PM (#34828076)
> in school we’re taught that only vowels get a before them

That's the opposite of how it works (as you demonstrated in your own comment, "not a rule...")

The comment you responded to was correct, or at least very reasonable, and I'm really not sure which part you disagree with.

Re:We Found an Neuron in GPT-2 by caf on Thursday February 16, 2023 @06:59PM (#34828601)
The word is "historic" either way, the commenter was using " 'istoric " as a way of indicating a particular pronunciation.

There's a few words in English that begin with the letter h but not with the consonant sound /h/ (depending on your accent!), mostly because they're French in origin: historic is one, and there's also hour, heir, honour. "It is an honour to be here"

Re:We Found an Neuron in GPT-2 by Tao3300 on Thursday February 16, 2023 @07:12PM (#34828730)
Yeah, where I'm from, since historic has the emphasis on STOR and not HI (as in history), the h is much softer, so it's pretty normal to say "an historic event" but also "a history of the world".

It's silly to act like there's a right or wrong. Dialects and accents are a special thing. Just be consistent.