pile EleutherAI
The Pile is a 825 GiB diverse, open source language modelling data set that consists of 22 smaller, high-quality datasets combined together.
- Type
- dataset
- License
- other
- Language
- en
- Downloads
- 2,877
- Likes
- 502
- Access
- public
- Files
- 0
Tags
- 预训练语料
- 文本数据集
- 语言建模
- 文本生成
- NLP
- 深度學習
README
--- annotations_creators: - no-annotation language_creators: - found language: - en license: other multilinguality: - monolingual pretty_name: the Pile size_categories: - 100B<n<1T source_datasets: - original task_categories: - text-generation - fill-mask task_ids: - language-modeling - masked-lang…