Re:Ask HN: What problem are you close to solving and how can...
by gpa on Sunday August 29, 2021 @03:52PM
(#28349899)
The problem - correct string matching at scale. I am aware of fuzzy string matching. The problem is that the two strings can be > 90% similar even if the difference is, for example, one digit in the year of manufacturing. My current solution is to represent the 2 strings as similar as I can based on the available information by transforming (wrangling) the data to match the data as close as possible and then applying constraints based on make, model and year (they should be the same). It works pretty well, but I am looking for a more interactive (human-in-the-loop) solution.
[ Parent
| on HN ]
Re:Ask HN: What problem are you close to solving and how can...
by wizzwizz4 on Sunday August 29, 2021 @04:03PM
(#28349987)
I'd just slap a GUI / audit logs on top. Show the intermediate data (the “wrangling”), show the computed similarities, show the conclusion (this met that threshold, and the other was equal, so it's category seven).