Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
Edit Datasets filters
Main
Tasks
Libraries
Languages
Licenses
Other
1
Reset Other
order-book
Synthetic
art
code
medical
biology
finance
legal
chemistry
agent
music
climate
Apply filters
Datasets
26
Full-text search
Edit filters
Sort: Trending
Active filters:
preference-optimization
Clear all
eren23/distilabel_first100_truthy-dpo-v0.1
Viewer
•
Updated
Feb 14, 2024
•
100
•
18
•
1
QuasarResearch/Quasar-RP-DPO-v0.1
Viewer
•
Updated
Feb 11, 2025
•
2.64k
•
28
•
4
kristaller486/wikisource_preferences_ru
Viewer
•
Updated
May 19, 2025
•
48.3k
•
89
stochastic-parrots/MNLP_M1_Preference_dpo_dataset
Viewer
•
Updated
May 24, 2025
•
17.6k
•
31
lemon07r/VellumK2-Unfettered-DPO-01
Viewer
•
Updated
Nov 7, 2025
•
2.58k
•
40
•
4
yuyouyu/MaterEvalData
Viewer
•
Updated
May 21
•
53.5k
•
59
•
1
anonymousML123/ISD-Instruction-Switch-Dataset
Viewer
•
Updated
Mar 15
•
3k
•
34
dgonier/ipda-grpo-dataset-iter3-feb-12
Viewer
•
Updated
Feb 13
•
2.99k
•
15
•
1
Yana/ft-llm-2026-reasoning-dpo
Viewer
•
Updated
Apr 16
•
130k
•
50
Taichi11/dpo_dataset_v1
Viewer
•
Updated
Mar 16
•
3.1k
•
12
wingchiuloong/CopyPasteSeed365
Viewer
•
Updated
Mar 7
•
365
•
93
•
1
YangL1122/DetailBench
Preview
•
Updated
Mar 9
•
22
Taichi11/dpo_dataset_v4
Viewer
•
Updated
Mar 18
•
2.88k
•
11
wuog/CertiCoder
Updated
Apr 14
•
66
•
1
bonneyjr/tenacious-bench
Preview
•
Updated
May 2
•
15
Dhanjo/ai-agent-security-dataset
Viewer
•
Updated
May 4
•
6.56k
•
76
xingyuHuxingyu/DynamicPO-Data
Viewer
•
Updated
Jun 10
•
357k
•
58
krystv/nomen-ai-dpo
Viewer
•
Updated
Jun 2
•
6k
•
18
ErenAta00/turkish-phishsoc-50k
Preview
•
Updated
Jun 7
•
13
stindardlogic/refusal-overrefusal-50k
Viewer
•
Updated
23 days ago
•
50k
•
81
plumliu/kuairand-recexplain-sft-dpo-data
Updated
Jun 22
•
47
•
1
johnhalloran/mcp-fbas
Viewer
•
Updated
Jul 8
•
2.93k
•
126
alwaysgood/dqs-post-training
Viewer
•
Updated
19 days ago
•
42.7k
•
151
btech-software/cosimo-cfa-frm-71k
Viewer
•
Updated
6 days ago
•
95.7k
•
51
worldbench/MIST-Train
Viewer
•
Updated
3 days ago
•
9.44k
•
43
odyn-network/benchmark-dpo-hyperparameters-v1
Viewer
•
Updated
2 days ago
•
49
•
29