Re:SymSpell: 1M times faster spelling correction
by ChrisMarshallNY on Sunday March 06, 2022 @08:36AM
(#30577515)
I used an old algorithm in a text search, called Metaphone[0]. It works relatively well, for English (There's a Spanish version, too). I used Double Metaphone.
Re:SymSpell: 1M times faster spelling correction
by faizshah on Sunday March 06, 2022 @12:17PM
(#30579086)
There's a pretty cool python library with a huge number of these if you want to experiment (GPLv3): https://github.com/chrislit/abydos
Re:SymSpell: 1M times faster spelling correction
by ars on Sunday March 06, 2022 @04:55PM
(#30581676)
Metaphone is good if you typed in something that sounds like the correct word. But often spelling typos are missing letters, or pressing a nearby letter instead of the one you meant.
For those the sound of the word isn't right, you need something that checks for nearby keys (I guess it needs to know the keyboard layout), and for missing or extra letters.
Re:SymSpell: 1M times faster spelling correction
by kevincox on Sunday March 06, 2022 @07:02PM
(#30582544)
There are definitely two related concerns here:
- I mistyped the word.
- I don't know how to spell the word.
The errors in these two look quite different and may need different methods of correcting.
Re:SymSpell: 1M times faster spelling correction
by ksec on Sunday March 06, 2022 @09:46AM
(#30577870)
Same here, Apple often auto correct my word into something else, or failed to even suggest the correct word. I had to use Google to get a correct spelling. ( I am not sure if I am alone in this sometimes I dont think I can spell any more. )
Re:SymSpell: 1M times faster spelling correction
by hashingroll on Sunday March 06, 2022 @06:49PM
(#30582464)
Comparing the spellcheck quality of Firefox to Google (search, not Chrome) might not be completely fair. The browser most likely uses a client-side spelling model with tight memory & performance constraints. The suggestions from Google come from high quality models hosted on their servers.
Re:SymSpell: 1M times faster spelling correction
by phkahler on Sunday March 06, 2022 @10:08AM
(#30578012)
https://en.wikipedia.org/wiki/Soundex#:~:text=Soundex%20is%2....
Soundex is a rough phonetic "spelling" used for such things. It's also something I never see mentioned.
Re:SymSpell: 1M times faster spelling correction
by ok123456 on Sunday March 06, 2022 @03:11PM
(#30580779)
Soundex was designed as a way to index last names before computers. It's primary benefit it that it's designed to do by hand. It performs pretty lousy as a general purpose natural language hashing scheme.
The precision and recall is too bad to use as a spell checker.
Re:SymSpell: 1M times faster spelling correction
by eloff on Sunday March 06, 2022 @01:20PM
(#30579673)
It's also pretty simple, I'm sure there are much better options readily available as libraries these days.
Re:SymSpell: 1M times faster spelling correction
by RobertMiller on Sunday March 06, 2022 @08:09PM
(#30582985)
Firefox's spelling correction is very poor. For instance, try spelling the name of a country starting with a lowercase letter and omitting a single letter.
"argetina" suggests "retina", Argentina isn't in the list.
"nethrlands" suggests "fatherland", Netherlands isn't in the list.
"ukriane" suggests "hurricane", Ukraine isn't in the list.
It fails for every country I try.
I wonder how difficult it would be to adapt this to work on sounds or other frequent typos and misspelling sources instead of just characters. It seems it should he possible if you can define a decent "normalization" function.