News for hackers. Stuff that matters.
Re:For ‘Big Data’ Scientists, Hurdle to Insights Is ‘Janitor... by ithayer on Monday August 18, 2014 @12:06PM (#8193222)
Probably way beyond the scope of that project, but actually this is a pretty interesting and well-studied problem called segmentation, where you train a system to insert the correct breaks. This is used in natural language problems like OCR or machine translation.

Maybe google "machine translation segmentation" or OCR for references to papers on the topic, but methods for doing this are really successful (especially on english).

There are no comments on this comment yet.