News for hackers. Stuff that matters.
Re:Show HN: Extract main ideas in your texts with SummarizeBot by amelius on Tuesday November 27, 2018 @05:46PM (#18547584)
Are there any benchmarks for this kind of task, and how well does this tool perform w.r.t. them?
Re:Show HN: Extract main ideas in your texts with SummarizeBot by team-o on Wednesday November 28, 2018 @08:47AM (#18551357)
In terms of measurement, there's ROUGE https://en.wikipedia.org/wiki/ROUGE_(metric) In this paper they discuss a few benchmarks in their introduction and describe a new benchmark. https://arxiv.org/pdf/1808.08745.pdf