News for hackers. Stuff that matters.
Re:Databricks Releases 15K Record Training Corpus for Instru... by ankitmathur on Wednesday April 12, 2023 @07:05PM (#35548298)
Out of curiosity: what's an example of a metric that you would use to evaluate the ability of the model? For example, just looking qualitatively, asking a prompt like "How do I tie a tie?" to Pythia produces content that isn't even reasonably responding to that. And yet many benchmarks have no problem with that

There are no comments on this comment yet.