UltraFeedback openbmb
Introduction GitHub Repo UltraRM-13b UltraCM-13b UltraFeedback is a large-scale, fine-grained, diverse preference dataset, used for training powerful reward models and critic models. We collect about 64k prompts from diverse resources (including UltraChat, ShareGPT, Evol-Instruct, TruthfulQA, FalseQA, and FLAN). We then use these prompts to query multiple LLMs (see Table for model lists) and generate 4 different responses for each prompt, resulting in a total of 256k samples. To… See the full description on the dataset page: https://huggingface.co/datasets/openbmb/UltraFeedback.
- Type
- dataset
- License
- mit
- Language
- en
- Downloads
- 5,838
- Likes
- 432
- Access
- public
- Files
- 0
Tags
- 人类反馈
- 指令微调
- 评测基准
- 文本数据集
- 生成式AI
- 大语言模型
- 强化学习
- 多教师
README
--- license: mit task_categories: - text-generation language: - en size_categories: - 100K<n<1M --- ## Introduction - [GitHub Repo](https://github.com/thunlp/UltraFeedback) - [UltraRM-13b](https://huggingface.co/openbmb/UltraRM-13b) - [UltraCM-13b](https://huggingface.co/openbmb/UltraCM-13b) UltraF…