News for hackers. Stuff that matters.
Re:SymSpell: 1M times faster spelling correction by kevincox on Sunday March 06, 2022 @08:33AM (#30577501)
This seems very focused on spelling. What I find is key for a good spell correction system is how the words sound. For example I find that Firefox often can't find the word I meant for it's suggestion list but pasting the misspelt word into Google gets the right result 99% of the time as the one provided option.

I wonder how difficult it would be to adapt this to work on sounds or other frequent typos and misspelling sources instead of just characters. It seems it should he possible if you can define a decent "normalization" function.

Re:SymSpell: 1M times faster spelling correction by ChrisMarshallNY on Sunday March 06, 2022 @08:36AM (#30577515)
I used an old algorithm in a text search, called Metaphone[0]. It works relatively well, for English (There's a Spanish version, too). I used Double Metaphone.

[0] https://en.wikipedia.org/wiki/Metaphone

Re:SymSpell: 1M times faster spelling correction by faizshah on Sunday March 06, 2022 @12:17PM (#30579086)
There's a pretty cool python library with a huge number of these if you want to experiment (GPLv3): https://github.com/chrislit/abydos
Re:SymSpell: 1M times faster spelling correction by ars on Sunday March 06, 2022 @04:55PM (#30581676)
Metaphone is good if you typed in something that sounds like the correct word. But often spelling typos are missing letters, or pressing a nearby letter instead of the one you meant.

For those the sound of the word isn't right, you need something that checks for nearby keys (I guess it needs to know the keyboard layout), and for missing or extra letters.

Re:SymSpell: 1M times faster spelling correction by kevincox on Sunday March 06, 2022 @07:02PM (#30582544)
There are definitely two related concerns here:

- I mistyped the word.

- I don't know how to spell the word.

The errors in these two look quite different and may need different methods of correcting.

Re:SymSpell: 1M times faster spelling correction by ksec on Sunday March 06, 2022 @09:46AM (#30577870)
Same here, Apple often auto correct my word into something else, or failed to even suggest the correct word. I had to use Google to get a correct spelling. ( I am not sure if I am alone in this sometimes I dont think I can spell any more. )
Re:SymSpell: 1M times faster spelling correction by hashingroll on Sunday March 06, 2022 @06:49PM (#30582464)
Comparing the spellcheck quality of Firefox to Google (search, not Chrome) might not be completely fair. The browser most likely uses a client-side spelling model with tight memory & performance constraints. The suggestions from Google come from high quality models hosted on their servers.
Re:SymSpell: 1M times faster spelling correction by phkahler on Sunday March 06, 2022 @10:08AM (#30578012)
https://en.wikipedia.org/wiki/Soundex#:~:text=Soundex%20is%2....

Soundex is a rough phonetic "spelling" used for such things. It's also something I never see mentioned.

Re:SymSpell: 1M times faster spelling correction by ok123456 on Sunday March 06, 2022 @03:11PM (#30580779)
Soundex was designed as a way to index last names before computers. It's primary benefit it that it's designed to do by hand. It performs pretty lousy as a general purpose natural language hashing scheme.

The precision and recall is too bad to use as a spell checker.

Re:SymSpell: 1M times faster spelling correction by eloff on Sunday March 06, 2022 @01:20PM (#30579673)
It's also pretty simple, I'm sure there are much better options readily available as libraries these days.
Re:SymSpell: 1M times faster spelling correction by RobertMiller on Sunday March 06, 2022 @08:09PM (#30582985)
Firefox's spelling correction is very poor. For instance, try spelling the name of a country starting with a lowercase letter and omitting a single letter.

"argetina" suggests "retina", Argentina isn't in the list.

"nethrlands" suggests "fatherland", Netherlands isn't in the list.

"ukriane" suggests "hurricane", Ukraine isn't in the list.

It fails for every country I try.