I wonder whether language models could be used to solve this problem. Convert every tag to a latent space vector and show the user all of the closest existing tags in a dropdown with the option to create a new one at the bottom.
Re:Taxonomy Is Hard
by karaterobot on Tuesday November 01, 2022 @05:23PM
(#33427692)
That would be a cool tool to have. In the end, it still comes down to humans being conscientious every time they add something to the library. The equivalent would be having really nice software development lifecycle processes: test suites, merge request gating, etc, and once in a while (ha ha) people still manage to push out half-baked changes when they're in a hurry. In the end it's a human issue, tools only do so much. And in domains outside of coding, it's harder to find regressions automatically, so they tend to go uncaught and accumulate.
Taking this a bit further, do we actually need “tags” that are identical? Rather than filter by a tag, perhaps you could enter a label or set of labels and sort by which results minimize a distance function in latent space. No matching or conscientiousness necessary.
Your options for finding out are:
1. Step back and do some research, look at all the tags and find ones that someone might have used to describe something similar, and then check the original item to make sure.
2. Ask your team if anybody has tagged something like this before.
3. Institute a sort of merge request process for new item tags.
4. Make up a new tag and move on.
Guess which option people usually go with?