Wow, I am trying to do something similar [0]. I have waited for someone to build something like this; giving it a go myself.
How much traction/revenue would you need to keep mnmn alive? Like, if you made $1000 per day you would probably keep it up?
Re:On “Learning to Summarize”
by simonebrunozzi on Thursday September 17, 2020 @08:44PM
(#24511754)
My initial analysis concluded that I could keep it alive, JUST for Hacker News "summaries", for something in the ballpark of $100,000/year. I'm sure you could do it cheaper (like 60-70k), but that budget includes consistent quality, which requires at least one full-time editor, and at least one part-time sw dev.
$1000 per day?
Yes, that amounts to $250,000 year.
Here's an example of how the Hacker News home page would be summarized: [1].
Instead, this "learning to summarize" article is about another interesting topic, which is how you teach an AI (GPT-2 and GPT-3) how to summarize text. It's also - bear with me - something dear to my heart, as I used to teach compilers at a CS course in an Italian university in 2004-2006, and I developed an interest for languages in general (not just computer ones).
This one below is the central point of the article, and it is indeed a crucial part of having success with an AI (note: LM stands for Language Model):
> IMO there are two almost unrelated ideas going on in OpenAI’s preference learning work.
> First, the idea of collecting binary preference annotations on LM samples, and (in some way) tuning the LM so its samples are better aligned with the preferences.
> Second, a specific method for tuning the sampling behavior of LMs to maximize an (arbitrary) score function defined over entire samples.
We are, IMHO, at the cusp of a true revolution in linguistics. Can't wait to see what happens in the coming 18-24 months. I expect to be blown away on at least a few fronts.
[0]: https://github.com/simonebrunozzi/MNMN
[1]: https://github.com/simonebrunozzi/MNMN/blob/master/Weekly-Su...