UltraFeedback openbmb
Introduction GitHub Repo UltraRM-13b UltraCM-13b UltraFeedback is a large-scale, fine-grained, diverse preference dataset, used for training powerful reward models and critic models. We collect about 64k prompts from diverse resources (including UltraChat, ShareGPT, Evol-Instruct, TruthfulQA, FalseQA, and FLAN). We then use these prompts to query multiple LLMs (see Table for model lists) and generate 4 different responses for each prompt, resulting in a total of 256k samples. To… See the full description on the dataset page: https://huggingface.co/datasets/openbmb/UltraFeedback.
- Tipo
- dataset
- Licencia
- mit
- Lenguaje
- en
- Descargas
- 5,838
- Me gusta
- 432
- Acceso
- public
- Archivos
- 0
README
--- license: mit task_categories: - text-generation language: - en size_categories: - 100K<n<1M --- ## Introduction - [GitHub Repo](https://github.com/thunlp/UltraFeedback) - [UltraRM-13b](https://huggingface.co/openbmb/UltraRM-13b) - [UltraCM-13b](https://huggingface.co/openbmb/UltraCM-13b) UltraF…