News for hackers. Stuff that matters.
Re:Nubia: A SoTA evaluation metric for text generation by pheme1 on Saturday May 02, 2020 @11:10AM (#23052185)
Based on your paper, it seems you didn't compare to other model based evaluation method such as Frechet Embedding Distance (FED). I would certainly like to see correlation study between each model evaluation method.
Re:Nubia: A SoTA evaluation metric for text generation by aliabd on Sunday May 03, 2020 @12:20AM (#23056834)
Thanks for your feedback, while we couldn't compare with all model-based methods out there, YiSi (August 2019) and BERTScore which was just presented at ICLR2020 this week (April 27th 2020) are very strong methods to compare against and reflect state-of-the-art. All comparisons are welcome!