Ask HN: I need to categorize 150,000 products

Re:Ask HN: I need to categorize 150,000 products by polyfractal on Saturday August 18, 2012 @10:18AM (#4401194)

I think this will be the solution I go with, but I'm a bit unsure how it would work in practice. I don't know how I would evaluate the accuracy of automated clustering?

Another solution might be a sort of automated-manual hybrid: e.g. identify common words/phrases in a particular category manually, write a script to find all items that have those, add to category.

[ Parent | on HN ]

Re:Ask HN: I need to categorize 150,000 products by DevAccount on Saturday August 18, 2012 @10:54AM (#4401281)

Well to write the automatic bit you'll have to manually figure out the rules :)

But yeah, something like that would be a good start. I don't know anything about this domain so I'm of limited help here. It might be too hard to categorize based solely on words if they're not distinct enough.

[ Parent | on HN ]

Re:Ask HN: I need to categorize 150,000 products by ig1 on Saturday August 18, 2012 @11:40AM (#4401389)

You could use an algorithm to identify keywords in your dataset and the manually classify the most common ones.

[ Parent | on HN ]