Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on RedPajama v2 Open Dataset with 30T Tokens for Training LLMs. Parent comment
- `rps_doc_ml_wikiref_score`: a classifier that classifiers random webpage with Wiki references (used in Llama-1)
- `ccnet_perplexity`: perplexity of an LM trained on Wikipedia (used in CCNet)
- `rps_doc_ml_wikipedia_score`: classifier prediction for the document being a Wikipedia article
- `rps_doc_wikipedia_importance`: Used in https://arxiv.org/abs/2302.03169
You can see the full table here: https://together.ai/blog/redpajama-data-v2
There are no comments on this comment yet.
- `rps_doc_ml_wikiref_score`: a classifier that classifiers random webpage with Wiki references (used in Llama-1)
- `ccnet_perplexity`: perplexity of an LM trained on Wikipedia (used in CCNet)
- `rps_doc_ml_wikipedia_score`: classifier prediction for the document being a Wikipedia article
- `rps_doc_wikipedia_importance`: Used in https://arxiv.org/abs/2302.03169
You can see the full table here: https://together.ai/blog/redpajama-data-v2