Datasets:
sample_id stringlengths 59 120 | error_type stringclasses 2
values | error_family stringclasses 2
values | correct_step stringlengths 6 170 | error_step stringlengths 11 172 | expected_correction stringlengths 29 144 | failure_mechanism stringlengths 48 216 | consequence_category stringclasses 76
values | dataset stringclasses 17
values | take_name stringlengths 8 52 | scenario stringclasses 69
values | view stringclasses 3
values | is_gui bool 1
class | duration_s float64 2.46 10 | dimension_scores dict | geometry dict | reason_code stringclasses 2
values | source_video stringlengths 44 146 | temporal dict | files dict | audit dict | pair dict | category stringclasses 1
value | provenance dict | _source_files dict | human_verification dict |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
v2_ab_letterbox_arm_B_ee4d_cmu_bike18_3_E01_wrong_execution_ab2e235d | wrong_execution | execution_deviation | Get bike tire lever | Get a flathead screwdriver. | Don't use a screwdriver, you'll pinch the tube—get a proper tire lever. | The sharp metal tip of the screwdriver will puncture the inner tube when prying the tire, ruining the repair and causing another flat. | wrong_object | EgoExo4D | ee4d_cmu_bike18_3 | Complete the Fix a Flat Tire - Replace a Bike Tube correctly | ego | false | 3.167 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/cmu_bike18_3/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 34.065,
"want_s": 3.258,
"aligned_source_interval": [
1.258,
3.258
]
} | {
"correct_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_cmu_bike18_3_E01_wrong_execution_ab2e235d/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_cmu_bike18_3_E01_wrong_execution_ab2e235d/error_context.mp4",
"correct_clip": "generation_error/samples/v2... | {
"sample_id": "v2_ab_letterbox_arm_B_ee4d_cmu_bike18_3_E01_wrong_execution_ab2e235d",
"label": "有问题",
"confidence": 0.7,
"error_start_s": 0,
"error_end_s": 2,
"visible_error": "操作者从工具包中拿出了一个一字螺丝刀，而非专业的自行车撬胎棒。",
"difference_from_correct": "正确动作应使用塑料撬胎棒以防损坏内胎，而视频2中错误地选择了金属一字螺丝刀。",
"physics_check": "通过",
... | {
"source_duration_s": 135.47,
"crop_start_s": 0,
"crop_end_s": 135.47,
"duration_s": 135.47,
"source_replacement_start_s": 34.065,
"source_replacement_end_s": 37.323,
"error_start_s": 34.065,
"error_end_s": 37.323,
"help_point_s": 34.065,
"duration_status": "within_target",
"continuity_policy": "... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_letterbox_arm_B_ee4d_cmu_bike18_3_E01_wr... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_cmu_bike18_3_E01_wrong_execution_ab2e235d/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_cmu_bike18_3_E01_wrong_execution_ab2... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:35:52.098491+00:00",
"note": ""
} |
v2_ab_letterbox_arm_B_ee4d_georgiatech_covid_03_4_E01_substitution_ebba414a | substitution | object_or_predicate_swap | Get the testing tube | Pick up the test cassette. | Put that down and get the little tube first; you need to mix the sample before using the cassette. | The user cannot mix the swab with the buffer liquid without the testing tube, halting the test procedure or leading to applying an unmixed sample. | wrong_object | EgoExo4D | ee4d_georgiatech_covid_03_4 | Complete the Covid-19 Rapid Antigen Test correctly | ego | false | 6.5 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/georgiatech_covid_03_4/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 171.434,
"want_s": 6.701,
"aligned_source_interval": [
0.502575,
6.701
]
} | {
"correct_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_georgiatech_covid_03_4_E01_substitution_ebba414a/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_georgiatech_covid_03_4_E01_substitution_ebba414a/error_context.mp4",
"correct_clip": "generation_er... | {
"sample_id": "v2_ab_letterbox_arm_B_ee4d_georgiatech_covid_03_4_E01_substitution_ebba414a",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 1,
"error_end_s": 6,
"visible_error": "用户拿起了测试卡（test cassette），而不是测试管（testing tube）。",
"difference_from_correct": "在视频1中，用户从包装袋中取出测试管；而在视频2中，用户拿起了测试卡并展示给镜头，忽略了... | {
"source_duration_s": 291.1,
"crop_start_s": 111.434,
"crop_end_s": 231.434,
"duration_s": 120,
"source_replacement_start_s": 171.434,
"source_replacement_end_s": 178.135,
"error_start_s": 60,
"error_end_s": 66.701,
"help_point_s": 61,
"duration_status": "within_target",
"continuity_policy": "120... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_letterbox_arm_B_ee4d_georgiatech_covid_0... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_georgiatech_covid_03_4_E01_substitution_ebba414a/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_georgiatech_covid_03_4_E01_su... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:36:00.093674+00:00",
"note": ""
} |
v2_ab_letterbox_arm_B_ee4d_georgiatech_covid_09_10_E01_wrong_execution_27102718 | wrong_execution | execution_deviation | Dip the swab into the testing tube | Rub the swab directly onto the sample well of the test cassette. | Wait, you need to mix the swab in the tube's liquid first! | Without the buffer liquid, the sample cannot flow across the test membrane via capillary action, resulting in an invalid test. | wrong_destination | EgoExo4D | ee4d_georgiatech_covid_09_10 | Complete the Covid-19 Rapid Antigen Test correctly | ego | false | 5 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/georgiatech_covid_09_10/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 135.148,
"want_s": 7.482,
"aligned_source_interval": [
4.30215,
7.482
]
} | {
"correct_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_georgiatech_covid_09_10_E01_wrong_execution_27102718/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_georgiatech_covid_09_10_E01_wrong_execution_27102718/error_context.mp4",
"correct_clip": "gener... | {
"sample_id": "v2_ab_letterbox_arm_B_ee4d_georgiatech_covid_09_10_E01_wrong_execution_27102718",
"label": "有问题",
"confidence": 0.75,
"error_start_s": 0,
"error_end_s": 4,
"visible_error": "直接用棉签涂抹测试卡槽，未先浸入试管中。",
"difference_from_correct": "正确操作需先将棉签与试管液体混合，视频2直接涂抹卡槽。",
"physics_check": "通过",
"reason"... | {
"source_duration_s": 276.77,
"crop_start_s": 75.148,
"crop_end_s": 195.148,
"duration_s": 120,
"source_replacement_start_s": 135.148,
"source_replacement_end_s": 142.63,
"error_start_s": 60,
"error_end_s": 67.482,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_letterbox_arm_B_ee4d_georgiatech_covid_0... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_georgiatech_covid_09_10_E01_wrong_execution_27102718/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_georgiatech_covid_09_10_E... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:36:07.018886+00:00",
"note": ""
} |
v2_ab_letterbox_arm_B_ee4d_iiith_cooking_05_1_E01_substitution_1645c8a7 | substitution | object_or_predicate_swap | Place the skillet or pan or pot on the stove | Place the pot on the counter next to the stove. | You need to put the pot on the stove, not leave it on the counter. | When the stove is turned on in a subsequent step, it will heat an empty burner while the pot on the counter remains cold, preventing the milk tea from brewing. | wrong_destination | EgoExo4D | ee4d_iiith_cooking_05_1 | Complete the Making Milk Tea correctly | ego | false | 3.542 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/iiith_cooking_05_1/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 62.41,
"want_s": 2.374,
"aligned_source_interval": [
0,
2.19595
]
} | {
"correct_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_05_1_E01_substitution_1645c8a7/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_05_1_E01_substitution_1645c8a7/error_context.mp4",
"correct_clip": "generation_error/samp... | {
"sample_id": "v2_ab_letterbox_arm_B_ee4d_iiith_cooking_05_1_E01_substitution_1645c8a7",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 0,
"error_end_s": 3.5,
"visible_error": "视频2中，红色的奶锅被放置在灶台旁的台面上，而非燃气灶上。",
"difference_from_correct": "视频1将奶锅放在灶上，视频2将奶锅放在台面上，导致无法加热。",
"physics_check": "通过",
"re... | {
"source_duration_s": 236.47,
"crop_start_s": 2.41,
"crop_end_s": 122.41,
"duration_s": 120,
"source_replacement_start_s": 62.41,
"source_replacement_end_s": 64.784,
"error_start_s": 60,
"error_end_s": 62.374,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_even... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_05_1_... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_05_1_E01_substitution_1645c8a7/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_05_1_E01_substituti... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:36:13.868386+00:00",
"note": ""
} |
v2_ab_letterbox_arm_B_ee4d_iiith_cooking_123_6_E01_substitution_3dd88139 | substitution | object_or_predicate_swap | Adjust the stove heat | Turn the knob for the adjacent empty burner. | You're turning the wrong knob, that's for the empty burner! | The milk tea boils over or scorches because the heat was not properly reduced, ruining the beverage. | wrong_object | EgoExo4D | ee4d_iiith_cooking_123_6 | Complete the Making Milk Tea correctly | ego | false | 5.583 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/iiith_cooking_123_6/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 1.575,
"want_s": 3.496,
"aligned_source_interval": [
0,
3.496
]
} | {
"correct_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_123_6_E01_substitution_3dd88139/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_123_6_E01_substitution_3dd88139/error_context.mp4",
"correct_clip": "generation_error/sa... | {
"sample_id": "v2_ab_letterbox_arm_B_ee4d_iiith_cooking_123_6_E01_substitution_3dd88139",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 1,
"error_end_s": 5,
"visible_error": "操作者没有调节放有奶茶锅的左侧炉灶旋钮，而是旋转了右侧空炉灶的旋钮，导致右侧空炉灶起火。",
"difference_from_correct": "正确动作中，操作者调节的是放有锅具的左侧炉灶旋钮；而错误动作中，操作者错误地调节了右侧空炉灶的旋... | {
"source_duration_s": 158.27,
"crop_start_s": 0,
"crop_end_s": 158.27,
"duration_s": 158.27,
"source_replacement_start_s": 1.575,
"source_replacement_end_s": 5.071,
"error_start_s": 1.575,
"error_end_s": 5.071,
"help_point_s": 2.575,
"duration_status": "within_target",
"continuity_policy": "full_... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_123_6... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_123_6_E01_substitution_3dd88139/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_123_6_E01_substitu... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:36:17.736120+00:00",
"note": ""
} |
v2_ab_letterbox_arm_B_ee4d_iiith_cooking_130_4_E04_wrong_execution_1f079552 | wrong_execution | execution_deviation | Lift the lid of a skillet or pan or pot | Lift the entire covered skillet off the burner and set it aside. | Leave the pan on the stove and just take the lid off. | The cooking process halts prematurely because the pan is off the heat, and the next ingredients cannot be added because the lid is still blocking the pan. | off_step | EgoExo4D | ee4d_iiith_cooking_130_4 | Complete the Cooking Tomato & Eggs correctly | ego | false | 4.083 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 3,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/iiith_cooking_130_4/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 312.981,
"want_s": 4.136,
"aligned_source_interval": [
1.5510000000000002,
4.136
]
} | {
"correct_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_130_4_E04_wrong_execution_1f079552/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_130_4_E04_wrong_execution_1f079552/error_context.mp4",
"correct_clip": "generation_er... | {
"sample_id": "v2_ab_letterbox_arm_B_ee4d_iiith_cooking_130_4_E04_wrong_execution_1f079552",
"label": "有问题",
"confidence": 0.7,
"error_start_s": 0,
"error_end_s": 3,
"visible_error": "操作者将整个带盖的平底锅移离炉灶并置于一旁，而非仅取下锅盖。",
"difference_from_correct": "视频1仅揭开锅盖，锅仍在炉上；视频2则将整个带盖锅具移走。",
"physics_check": "通过",
"... | {
"source_duration_s": 347.37,
"crop_start_s": 227.37,
"crop_end_s": 347.37,
"duration_s": 120,
"source_replacement_start_s": 312.981,
"source_replacement_end_s": 317.117,
"error_start_s": 85.611,
"error_end_s": 89.747,
"help_point_s": 85.611,
"duration_status": "within_target",
"continuity_policy... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_130_4... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_130_4_E04_wrong_execution_1f079552/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_130_4_E04_wrong... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:36:38.255610+00:00",
"note": ""
} |
v2_ab_letterbox_arm_B_ee4d_iiith_cooking_25_3_E01_wrong_execution_77924fa7 | wrong_execution | execution_deviation | Add onion powder to a mixing bowl | Sprinkle the onion powder onto the cutting board instead of into the mixing bowl. | You're sprinkling the powder on the board instead of in the bowl! | The seasoning fails to reach the salad mixture, resulting in an incorrectly flavored dish. | wrong_destination | EgoExo4D | ee4d_iiith_cooking_25_3 | Complete the Making Cucumber & Tomato Salad correctly | ego | false | 5.208 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 3,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/iiith_cooking_25_3/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 84.114,
"want_s": 4.306,
"aligned_source_interval": [
0.32294999999999996,
3.55245
]
} | {
"correct_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_25_3_E01_wrong_execution_77924fa7/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_25_3_E01_wrong_execution_77924fa7/error_context.mp4",
"correct_clip": "generation_erro... | {
"sample_id": "v2_ab_letterbox_arm_B_ee4d_iiith_cooking_25_3_E01_wrong_execution_77924fa7",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 1,
"error_end_s": 3,
"visible_error": "洋葱粉被撒在砧板上而非碗中。",
"difference_from_correct": "正确步骤应将粉末加入碗内，错误步骤将其撒在砧板上。",
"physics_check": "通过",
"reason": "视频2中明显可见调料被... | {
"source_duration_s": 111.8,
"crop_start_s": 0,
"crop_end_s": 111.8,
"duration_s": 111.8,
"source_replacement_start_s": 84.114,
"source_replacement_end_s": 88.42,
"error_start_s": 84.114,
"error_end_s": 88.42,
"help_point_s": 85.114,
"duration_status": "within_target",
"continuity_policy": "full_... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_25_3_... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_25_3_E01_wrong_execution_77924fa7/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_25_3_E01_wrong_e... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:36:45.748220+00:00",
"note": ""
} |
v2_ab_letterbox_arm_B_ee4d_sfu_cooking023_6_E01_wrong_execution_4014446b | wrong_execution | execution_deviation | Pour egg mixture into a skillet | Pour the egg mixture down the sink drain. | Stop, don't pour the eggs down the sink! | The eggs are lost down the drain, leaving nothing to scramble. | wrong_destination | EgoExo4D | ee4d_sfu_cooking023_6 | Complete the Cooking Scrambled Eggs correctly | ego | false | 6.333 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 3,
"action_timing": 4,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/sfu_cooking023_6/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 48.056,
"want_s": 3.949,
"aligned_source_interval": [
0,
3.949
]
} | {
"correct_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_sfu_cooking023_6_E01_wrong_execution_4014446b/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_sfu_cooking023_6_E01_wrong_execution_4014446b/error_context.mp4",
"correct_clip": "generation_error/sa... | {
"sample_id": "v2_ab_letterbox_arm_B_ee4d_sfu_cooking023_6_E01_wrong_execution_4014446b",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 1,
"error_end_s": 5,
"visible_error": "将蛋液倒入水槽而非平底锅。",
"difference_from_correct": "正确动作是倒入平底锅，错误动作是倒入水槽。",
"physics_check": "通过",
"reason": "视频2中将蛋液倒入水槽，属于明显的错... | {
"source_duration_s": 423.7,
"crop_start_s": 0,
"crop_end_s": 120,
"duration_s": 120,
"source_replacement_start_s": 48.056,
"source_replacement_end_s": 52.005,
"error_start_s": 48.056,
"error_end_s": 52.005,
"help_point_s": 49.056,
"duration_status": "within_target",
"continuity_policy": "120s_ev... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_letterbox_arm_B_ee4d_sfu_cooking023_6_E0... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_sfu_cooking023_6_E01_wrong_execution_4014446b/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_sfu_cooking023_6_E01_wrong_execu... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:37:17.444109+00:00",
"note": ""
} |
v2_ab_letterbox_arm_B_ee4d_uniandes_cooking_001_12_E01_substitution_ecbaddd2 | substitution | object_or_predicate_swap | Get spoon | Get a fork. | You grabbed a fork, you need a spoon for the foam. | Milk foam will pass right through the tines of the fork, making it impossible to scoop or hold back the foam to finish the latte. | wrong_object | EgoExo4D | ee4d_uniandes_cooking_001_12 | Complete the Making Coffee latte correctly | ego | false | 3.167 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/uniandes_cooking_001_12/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 270.541,
"want_s": 2.775,
"aligned_source_interval": [
0,
2
]
} | {
"correct_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_uniandes_cooking_001_12_E01_substitution_ecbaddd2/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_uniandes_cooking_001_12_E01_substitution_ecbaddd2/error_context.mp4",
"correct_clip": "generation_... | {
"sample_id": "v2_ab_letterbox_arm_B_ee4d_uniandes_cooking_001_12_E01_substitution_ecbaddd2",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 0,
"error_end_s": 2,
"visible_error": "视频中拿取了叉子而不是勺子。",
"difference_from_correct": "正确动作应该拿取勺子，而视频2中拿取了叉子。",
"physics_check": "通过",
"reason": "视频2中清晰地展示了拿... | {
"source_duration_s": 483.07,
"crop_start_s": 210.541,
"crop_end_s": 330.541,
"duration_s": 120,
"source_replacement_start_s": 270.541,
"source_replacement_end_s": 273.316,
"error_start_s": 60,
"error_end_s": 62.775,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "12... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_letterbox_arm_B_ee4d_uniandes_cooking_00... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_uniandes_cooking_001_12_E01_substitution_ecbaddd2/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_uniandes_cooking_001_12_E01_... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:37:25.390111+00:00",
"note": ""
} |
v2_ab_letterbox_arm_B_ee4d_uniandes_cooking_006_4_E01_substitution_02ca90f4 | substitution | object_or_predicate_swap | Place water on the stove | Place the milk pitcher on the stove. | Wait, you need to boil the water for the espresso first, not the milk. | The espresso cannot be brewed without boiling water, halting the latte-making process, and the milk might scald on the direct heat. | wrong_object | EgoExo4D | ee4d_uniandes_cooking_006_4 | Complete the Making Coffee latte correctly | ego | false | 3.5 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 2,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | promoted_after_review | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/uniandes_cooking_006_4/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 92.517,
"want_s": 2.167,
"aligned_source_interval": [
0,
2.167
]
} | {
"correct_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_uniandes_cooking_006_4_E01_substitution_02ca90f4/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_uniandes_cooking_006_4_E01_substitution_02ca90f4/error_context.mp4",
"correct_clip": "generation_er... | {
"sample_id": "v2_ab_letterbox_arm_B_ee4d_uniandes_cooking_006_4_E01_substitution_02ca90f4",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 0,
"error_end_s": 3,
"visible_error": "视频2中将装有牛奶的拉花杯直接放在燃气灶上加热，而不是加热水。",
"difference_from_correct": "视频1中加热的是水，而视频2中错误地将牛奶杯放在火上加热。",
"physics_check": "通过",
... | {
"source_duration_s": 263.27,
"crop_start_s": 32.517,
"crop_end_s": 152.517,
"duration_s": 120,
"source_replacement_start_s": 92.517,
"source_replacement_end_s": 94.684,
"error_start_s": 60,
"error_end_s": 62.167,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_letterbox_arm_B_ee4d_uniandes_cooking_00... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_uniandes_cooking_006_4_E01_substitution_02ca90f4/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_uniandes_cooking_006_4_E01_su... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:37:50.298194+00:00",
"note": ""
} |
v2_ab_prompt_arm_A_ee4d_uniandes_cooking_005_6_E01_substitution_77041708 | substitution | object_or_predicate_swap | Get a cup or mug | Get a small espresso cup. | You'll need a bigger mug for a latte, that espresso cup is too small. | The vessel's capacity is too small for the intended drink, preventing the addition of the required amount of steamed milk. | wrong_object | EgoExo4D | ee4d_uniandes_cooking_005_6 | Complete the Making Coffee latte correctly | ego | false | 3.167 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 3,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/uniandes_cooking_005_6/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 85.939,
"want_s": 4.817,
"aligned_source_interval": [
2.769775,
4.817
]
} | {
"correct_context": "generation_error/samples/v2_ab_prompt_arm_A_ee4d_uniandes_cooking_005_6_E01_substitution_77041708/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_prompt_arm_A_ee4d_uniandes_cooking_005_6_E01_substitution_77041708/error_context.mp4",
"correct_clip": "generation_error/sa... | {
"sample_id": "v2_ab_prompt_arm_A_ee4d_uniandes_cooking_005_6_E01_substitution_77041708",
"label": "有问题",
"confidence": 0.9,
"error_start_s": 0,
"error_end_s": 1.5,
"visible_error": "视频2中，操作者拿取并使用了一个小的浓缩咖啡杯，而不是像视频1中那样拿取一个适合做拿铁的大马克杯。",
"difference_from_correct": "视频1中操作者拿取的是一个白色的大马克杯；而视频2中操作者拿取并使用的是一个非常小的... | {
"source_duration_s": 321.17,
"crop_start_s": 25.939,
"crop_end_s": 145.939,
"duration_s": 120,
"source_replacement_start_s": 85.939,
"source_replacement_end_s": 90.756,
"error_start_s": 60,
"error_end_s": 64.817,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_prompt_arm_A_ee4d_uniandes_cooking_005_6... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_prompt_arm_A_ee4d_uniandes_cooking_005_6_E01_substitution_77041708/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_prompt_arm_A_ee4d_uniandes_cooking_005_6_E01_substitu... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:38:19.973515+00:00",
"note": ""
} |
v2_ab_prompt_arm_B_ee4d_iiith_cooking_43_3_E03_substitution_e7a4778b | substitution | object_or_predicate_swap | Wipe hands | Wipe hands with the wet dish sponge. | Don't use the dish sponge on your hands, grab the towel! | Soap or bacteria from the sponge contaminates the hands, which then handle the raw salad ingredients, making the salad inedible or unsafe. | wrong_state | EgoExo4D | ee4d_iiith_cooking_43_3 | Complete the Making Cucumber & Tomato Salad correctly | ego | false | 3.25 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/iiith_cooking_43_3/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 80.407,
"want_s": 2.178,
"aligned_source_interval": [
0,
2.01465
]
} | {
"correct_context": "generation_error/samples/v2_ab_prompt_arm_B_ee4d_iiith_cooking_43_3_E03_substitution_e7a4778b/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_prompt_arm_B_ee4d_iiith_cooking_43_3_E03_substitution_e7a4778b/error_context.mp4",
"correct_clip": "generation_error/samples/v2... | {
"sample_id": "v2_ab_prompt_arm_B_ee4d_iiith_cooking_43_3_E03_substitution_e7a4778b",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 0,
"error_end_s": 2,
"visible_error": "视频2中，人使用黄绿色的洗碗海绵来擦手，而不是使用旁边的格子抹布。",
"difference_from_correct": "视频1中，人使用格子抹布擦手；而视频2中，人错误地使用洗碗海绵擦手。",
"physics_check": "通过",
... | {
"source_duration_s": 120.67,
"crop_start_s": 0,
"crop_end_s": 120.67,
"duration_s": 120.67,
"source_replacement_start_s": 80.407,
"source_replacement_end_s": 82.585,
"error_start_s": 80.407,
"error_end_s": 82.585,
"help_point_s": 80.407,
"duration_status": "within_target",
"continuity_policy": "... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_prompt_arm_B_ee4d_iiith_cooking_43_3_E03... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_prompt_arm_B_ee4d_iiith_cooking_43_3_E03_substitution_e7a4778b/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_prompt_arm_B_ee4d_iiith_cooking_43_3_E03_substitution_e7a... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:38:37.482064+00:00",
"note": ""
} |
v2_ab_prompt_arm_B_ee4d_upenn_0714_Cooking_1_4_E01_wrong_execution_f2337413 | wrong_execution | execution_deviation | Throw out trash or waste | Sweep the unused ginger root into the trash bin. | Watch out, you're throwing away the good ginger! | The usable ginger is lost in the trash, meaning it cannot be used for the rest of the recipe or future meals. | wrong_object | EgoExo4D | ee4d_upenn_0714_Cooking_1_4 | Complete the Making Sesame-Ginger Asian Salad correctly | ego | false | 4.333 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 3,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/upenn_0714_Cooking_1_4/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 309.966,
"want_s": 4.38,
"aligned_source_interval": [
1.6425,
4.38
]
} | {
"correct_context": "generation_error/samples/v2_ab_prompt_arm_B_ee4d_upenn_0714_Cooking_1_4_E01_wrong_execution_f2337413/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_prompt_arm_B_ee4d_upenn_0714_Cooking_1_4_E01_wrong_execution_f2337413/error_context.mp4",
"correct_clip": "generation_er... | {
"sample_id": "v2_ab_prompt_arm_B_ee4d_upenn_0714_Cooking_1_4_E01_wrong_execution_f2337413",
"label": "有问题",
"confidence": 0.7,
"error_start_s": 1,
"error_end_s": 3,
"visible_error": "操作者将装有完好生姜的粉色塑料袋直接扔进垃圾桶。",
"difference_from_correct": "正确视频中仅丢弃了厨余垃圾，而错误视频中丢弃了完好且可用的生姜。",
"physics_check": "通过",
"rea... | {
"source_duration_s": 653.77,
"crop_start_s": 249.966,
"crop_end_s": 369.966,
"duration_s": 120,
"source_replacement_start_s": 309.966,
"source_replacement_end_s": 314.346,
"error_start_s": 60,
"error_end_s": 64.38,
"help_point_s": 61,
"duration_status": "within_target",
"continuity_policy": "120... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_prompt_arm_B_ee4d_upenn_0714_Cooking_1_4... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_prompt_arm_B_ee4d_upenn_0714_Cooking_1_4_E01_wrong_execution_f2337413/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_prompt_arm_B_ee4d_upenn_0714_Cooking_1_4_E01_wrong... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:39:17.666876+00:00",
"note": ""
} |
v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E01_substitution_57e08103 | substitution | object_or_predicate_swap | Wash the metal bowl with water | Wipe the metal bowl with a dry paper towel. | You need to actually wash that bowl with water, not just wipe it. | Cross-contamination or ruined texture in the next step because the bowl wasn't properly cleaned. | wrong_state | autoann | auto_eel_bee93bfc | Complete the laboratory or kitchen task correctly | unspecified | false | 5.667 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee93bfc-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 121.55,
"want_s": 6.75,
"aligned_source_interval": [
0,
6.24375
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E01_substitution_57e08103/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E01_substitution_57e08103/error_context.mp4",
"correct_clip": "generation_erro... | {
"sample_id": "v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E01_substitution_57e08103",
"label": "有问题",
"confidence": 1,
"error_start_s": 0,
"error_end_s": 5,
"visible_error": "视频2中，操作人员使用干纸巾擦拭金属碗，而不是像视频1中那样用清水冲洗金属碗。",
"difference_from_correct": "视频1中，操作人员在水龙头下用清水冲洗并清洗金属碗；而视频2中，操作人员仅用干纸巾擦拭金属碗，没有用水清洗。... | {
"source_duration_s": 665.6,
"crop_start_s": 61.55,
"crop_end_s": 181.55,
"duration_s": 120,
"source_replacement_start_s": 121.55,
"source_replacement_end_s": 128.3,
"error_start_s": 60,
"error_end_s": 66.75,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee93b... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E01_substitution_57e08103/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E01_subs... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:39:43.876641+00:00",
"note": ""
} |
v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E03_wrong_execution_4f016a34 | wrong_execution | execution_deviation | Pour water from the bowl into the wok | Pour oil from the bowl into the wok. | Wait, that's the oil, you need to pour the water in! | Adding oil instead of water alters the cooking process, which will ruin the intended texture, flavor, and outcome of the recipe. | wrong_object | autoann | auto_eel_bee93bfc | Complete the laboratory or kitchen task correctly | unspecified | false | 3.958 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 3,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee93bfc-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 345.7,
"want_s": 2.5,
"aligned_source_interval": [
0,
2.5
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E03_wrong_execution_4f016a34/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E03_wrong_execution_4f016a34/error_context.mp4",
"correct_clip": "generatio... | {
"sample_id": "v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E03_wrong_execution_4f016a34",
"label": "有问题",
"confidence": 0.75,
"error_start_s": 0,
"error_end_s": 3,
"visible_error": "视频2中向锅内倒入的是黄色液体（疑似蛋液或油），而非清水。",
"difference_from_correct": "视频1中准备倒入的是清水，而视频2中错误地倒入黄色液体，不符合正确步骤。",
"physics_check": ... | {
"source_duration_s": 665.6,
"crop_start_s": 285.7,
"crop_end_s": 405.7,
"duration_s": 120,
"source_replacement_start_s": 345.7,
"source_replacement_end_s": 348.2,
"error_start_s": 60,
"error_end_s": 62.5,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event_ce... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee93b... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E03_wrong_execution_4f016a34/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E03_w... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:40:04.165108+00:00",
"note": ""
} |
v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_substitution_24218dc3 | substitution | object_or_predicate_swap | Cut the peeled garlic into small pieces on the cutting board | Cut the unpeeled garlic clove into small pieces on the cutting board. | Wait, you need to peel that clove before you chop it! | Inedible garlic skin is incorporated into the prepped ingredients, which will ruin the texture and mouthfeel of the final dish. | wrong_object | autoann | auto_eel_bee94084 | Complete the laboratory or kitchen task correctly | unspecified | false | 9.833 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee94084-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 573.1,
"want_s": 14.5,
"aligned_source_interval": [
0,
14.5
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_substitution_24218dc3/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_substitution_24218dc3/error_context.mp4",
"correct_clip": "generation_erro... | {
"sample_id": "v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_substitution_24218dc3",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 1,
"error_end_s": 8,
"visible_error": "操作者直接切未剥皮的整头大蒜，导致蒜皮混入其中。",
"difference_from_correct": "视频1切的是已剥皮的干净蒜瓣，视频2切的是带皮的整蒜。",
"physics_check": "通过",
"reason": ... | {
"source_duration_s": 1043.36,
"crop_start_s": 513.1,
"crop_end_s": 633.1,
"duration_s": 120,
"source_replacement_start_s": 573.1,
"source_replacement_end_s": 587.6,
"error_start_s": 60,
"error_end_s": 74.5,
"help_point_s": 61,
"duration_status": "within_target",
"continuity_policy": "120s_event_... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee940... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_substitution_24218dc3/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_subs... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:40:32.239446+00:00",
"note": ""
} |
v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_wrong_execution_6a9c60c8 | wrong_execution | execution_deviation | Cut the peeled garlic into small pieces on the cutting board | Cut the ginger into small pieces on the countertop. | That's the ginger, not the garlic, and you shouldn't cut directly on the counter! | The dish will have the wrong flavor profile because ginger is added instead of garlic, and the countertop may be damaged or contaminated. | wrong_object | autoann | auto_eel_bee94084 | Complete the laboratory or kitchen task correctly | unspecified | false | 7.333 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 2,
"action_timing": 4,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | promoted_after_review | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee94084-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 573.1,
"want_s": 14.5,
"aligned_source_interval": [
0,
13.4125
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_wrong_execution_6a9c60c8/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_wrong_execution_6a9c60c8/error_context.mp4",
"correct_clip": "generatio... | {
"sample_id": "v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_wrong_execution_6a9c60c8",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 0,
"error_end_s": 6,
"visible_error": "操作者在白色台面上直接切生姜，而不是在砧板上切大蒜。",
"difference_from_correct": "正确步骤是在砧板上切碎大蒜，错误步骤是直接在台面上切生姜。",
"physics_check": "通过",
"re... | {
"source_duration_s": 1043.36,
"crop_start_s": 513.1,
"crop_end_s": 633.1,
"duration_s": 120,
"source_replacement_start_s": 573.1,
"source_replacement_end_s": 587.6,
"error_start_s": 60,
"error_end_s": 74.5,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event_... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee940... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_wrong_execution_6a9c60c8/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_w... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:40:40.145012+00:00",
"note": ""
} |
v2_dataset_v2_batch3_autoann_A_auto_eel_bee94138_E02_wrong_execution_096cfcca | wrong_execution | execution_deviation | Hold the leek and cut off its root | Hold the leek and cut off its green top. | Wait, you need to cut off the root end first! | If the root is not removed, dirt and the tough root base will end up in the chopped leek. | wrong_state | autoann | auto_eel_bee94138 | Complete the laboratory or kitchen task correctly | unspecified | false | 9 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 3,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee94138-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 168.55,
"want_s": 5.75,
"aligned_source_interval": [
0,
5.75
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94138_E02_wrong_execution_096cfcca/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94138_E02_wrong_execution_096cfcca/error_context.mp4",
"correct_clip": "generatio... | {
"sample_id": "v2_dataset_v2_batch3_autoann_A_auto_eel_bee94138_E02_wrong_execution_096cfcca",
"label": "有问题",
"confidence": 0.75,
"error_start_s": 2,
"error_end_s": 6,
"visible_error": "操作者切断了大葱的绿色叶梢部分，而非切除根部。",
"difference_from_correct": "正确动作应切除大葱根部，视频2中却切掉了绿色的叶子顶部。",
"physics_check": "通过",
"reaso... | {
"source_duration_s": 698.56,
"crop_start_s": 108.55,
"crop_end_s": 228.55,
"duration_s": 120,
"source_replacement_start_s": 168.55,
"source_replacement_end_s": 174.3,
"error_start_s": 60,
"error_end_s": 65.75,
"help_point_s": 62,
"duration_status": "within_target",
"continuity_policy": "120s_eve... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee941... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94138_E02_wrong_execution_096cfcca/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94138_E02_w... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:40:46.046401+00:00",
"note": ""
} |
v2_dataset_v2_batch3_autoann_A_auto_eel_bee94138_E04_wrong_execution_22d18308 | wrong_execution | execution_deviation | Pour soy sauce from the bottle into the pan | Pour soy sauce from the bottle into the prep bowl. | Wait, the soy sauce goes directly into the pan, not the bowl! | The dish lacks the required seasoning during the active cooking phase, resulting in an improperly flavored meal. | wrong_destination | autoann | auto_eel_bee94138 | Complete the laboratory or kitchen task correctly | unspecified | false | 3.167 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 2,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | promoted_after_review | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee94138-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 598.05,
"want_s": 2,
"aligned_source_interval": [
0,
2
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94138_E04_wrong_execution_22d18308/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94138_E04_wrong_execution_22d18308/error_context.mp4",
"correct_clip": "generatio... | {
"sample_id": "v2_dataset_v2_batch3_autoann_A_auto_eel_bee94138_E04_wrong_execution_22d18308",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 0,
"error_end_s": 2,
"visible_error": "视频2中将酱油倒入碗中，而不是直接倒入锅中。",
"difference_from_correct": "视频1中酱油直接加入锅内，视频2中则倒入旁边的碗里。",
"physics_check": "通过",
"reason": ... | {
"source_duration_s": 698.56,
"crop_start_s": 538.05,
"crop_end_s": 658.05,
"duration_s": 120,
"source_replacement_start_s": 598.05,
"source_replacement_end_s": 600.05,
"error_start_s": 60,
"error_end_s": 62,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee941... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94138_E04_wrong_execution_22d18308/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94138_E04_w... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:40:56.731122+00:00",
"note": ""
} |
v2_dataset_v2_batch3_autoann_A_auto_eel_bee9434a_E03_wrong_execution_98b28c65 | wrong_execution | execution_deviation | Pour chicken essence seasoning into the pan | Pour salt into the pan. | Wait, you're adding salt, not the chicken essence! | Adding the wrong seasoning ruins the intended taste and balance of the recipe. | wrong_object | autoann | auto_eel_bee9434a | Complete the laboratory or kitchen task correctly | unspecified | false | 6.458 | {
"error_semantics": 3,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 2,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | promoted_after_review | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee9434a-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 570.5,
"want_s": 4.75,
"aligned_source_interval": [
0.35624999999999996,
4.39375
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9434a_E03_wrong_execution_98b28c65/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9434a_E03_wrong_execution_98b28c65/error_context.mp4",
"correct_clip": "generatio... | {
"sample_id": "v2_dataset_v2_batch3_autoann_A_auto_eel_bee9434a_E03_wrong_execution_98b28c65",
"label": "有问题",
"confidence": 0.7,
"error_start_s": 0,
"error_end_s": 5,
"visible_error": "视频2中向锅中倒入的是大量食盐，而非鸡精调味品。",
"difference_from_correct": "视频1倒入黄色袋装鸡精，视频2倒入白色瓶装食盐。",
"physics_check": "通过",
"reason": ... | {
"source_duration_s": 647.48,
"crop_start_s": 510.5,
"crop_end_s": 630.5,
"duration_s": 120,
"source_replacement_start_s": 570.5,
"source_replacement_end_s": 575.25,
"error_start_s": 60,
"error_end_s": 64.75,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee943... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9434a_E03_wrong_execution_98b28c65/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9434a_E03_w... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:41:22.110061+00:00",
"note": ""
} |
v2_dataset_v2_batch3_autoann_A_auto_eel_bee9444e_E02_wrong_execution_987aa322 | wrong_execution | execution_deviation | Pour some vinegar from the bottle into the wok | Pour some vinegar from the bottle into the small prep bowl next to the wok. | Wait, pour the vinegar directly into the wok, not into that bowl! | The recipe fails because a key flavoring ingredient is missing from the main dish during the cooking process. | wrong_destination | autoann | auto_eel_bee9444e | Complete the laboratory or kitchen task correctly | unspecified | false | 3.167 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee9444e-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 757.75,
"want_s": 2.25,
"aligned_source_interval": [
0.25,
2.25
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9444e_E02_wrong_execution_987aa322/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9444e_E02_wrong_execution_987aa322/error_context.mp4",
"correct_clip": "generatio... | {
"sample_id": "v2_dataset_v2_batch3_autoann_A_auto_eel_bee9444e_E02_wrong_execution_987aa322",
"label": "有问题",
"confidence": 0.7,
"error_start_s": 0,
"error_end_s": 2,
"visible_error": "将调味汁倒入炒锅旁的金属小碗中，而非直接倒入炒锅内。",
"difference_from_correct": "正确动作是将调料直接倒入炒锅，错误动作则是倒入旁边的备用小碗中。",
"physics_check": "通过",
... | {
"source_duration_s": 876.92,
"crop_start_s": 697.75,
"crop_end_s": 817.75,
"duration_s": 120,
"source_replacement_start_s": 757.75,
"source_replacement_end_s": 760,
"error_start_s": 60,
"error_end_s": 62.25,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee944... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9444e_E02_wrong_execution_987aa322/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9444e_E02_w... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:41:32.783349+00:00",
"note": ""
} |
v2_dataset_v2_batch3_autoann_A_auto_eel_bee9470a_E01_substitution_fe2a08d7 | substitution | object_or_predicate_swap | Use a piece of fat to wipe the wok | Use a piece of lean meat to wipe the wok. | That's the lean meat, you need the fat to oil the wok! | Without the rendered fat, the wok lacks a non-stick coating, causing subsequent ingredients to stick and burn. | wrong_object | autoann | auto_eel_bee9470a | Complete the laboratory or kitchen task correctly | unspecified | false | 4.792 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee9470a-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 211.15,
"want_s": 3,
"aligned_source_interval": [
0,
3
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9470a_E01_substitution_fe2a08d7/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9470a_E01_substitution_fe2a08d7/error_context.mp4",
"correct_clip": "generation_erro... | {
"sample_id": "v2_dataset_v2_batch3_autoann_A_auto_eel_bee9470a_E01_substitution_fe2a08d7",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 0,
"error_end_s": 4,
"visible_error": "在视频2中，操作者使用了一大块红色的瘦肉（牛排）来擦拭锅底，而不是像视频1中那样使用一块肥肉。",
"difference_from_correct": "视频1中使用的是一小块白色的肥肉来润锅，而视频2中错误地使用了一整块红色的瘦肉。",
... | {
"source_duration_s": 965.84,
"crop_start_s": 151.15,
"crop_end_s": 271.15,
"duration_s": 120,
"source_replacement_start_s": 211.15,
"source_replacement_end_s": 214.15,
"error_start_s": 60,
"error_end_s": 63,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee947... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9470a_E01_substitution_fe2a08d7/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9470a_E01_subs... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:41:46.801068+00:00",
"note": ""
} |
v2_dataset_v2_batch3_autoann_A_auto_eel_bee94ac0_E01_substitution_2d6129ce | substitution | object_or_predicate_swap | Wash the peeled garlic cloves under the faucet | Wash the peeled garlic cloves with dish soap under the faucet. | Don't use dish soap on the food! | The ingredient is ruined by the soap, making the resulting dish taste like detergent and rendering it unsafe to eat. | wrong_state | autoann | auto_eel_bee94ac0 | Complete the laboratory or kitchen task correctly | unspecified | false | 3.167 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee94ac0-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 180.65,
"want_s": 2,
"aligned_source_interval": [
0,
2
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94ac0_E01_substitution_2d6129ce/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94ac0_E01_substitution_2d6129ce/error_context.mp4",
"correct_clip": "generation_erro... | {
"sample_id": "v2_dataset_v2_batch3_autoann_A_auto_eel_bee94ac0_E01_substitution_2d6129ce",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 0,
"error_end_s": 2,
"visible_error": "在清洗剥好的大蒜时，使用了洗洁精，导致双手和大蒜上布满了白色泡沫。",
"difference_from_correct": "正确视频中仅用清水冲洗大蒜，而错误视频中使用了洗洁精，产生了大量泡沫，这会污染食物。",
"physics_c... | {
"source_duration_s": 1005.76,
"crop_start_s": 120.65,
"crop_end_s": 240.65,
"duration_s": 120,
"source_replacement_start_s": 180.65,
"source_replacement_end_s": 182.65,
"error_start_s": 60,
"error_end_s": 62,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_even... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94a... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94ac0_E01_substitution_2d6129ce/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94ac0_E01_subs... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:41:59.376438+00:00",
"note": ""
} |
v2_dataset_v2_batch3_densestep_A_ds_EXZIpIsahzU_E01_wrong_execution_1751fde1 | wrong_execution | execution_deviation | Cut out green leaves from the green felt. | Cut out leaves from the red felt. | Wait, you are supposed to use the green felt for the leaves, not the red one! | The final assembled craft will have incorrectly colored parts, failing the design requirements. | wrong_object | DenseStep2M/HowTo100M | ds_EXZIpIsahzU | Complete the instructional task correctly | unspecified | false | 3.167 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1280x720",
"generated": "1280x720",
"exact_size_match": true,
"aspect_preserved": true,
"area_ratio": 1
} | passed_lean_gates | <source>/source_videos/densestep/EXZIpIsahzU.mp4 | {
"step_index": 523.26,
"want_s": 2,
"aligned_source_interval": [
0,
2
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_densestep_A_ds_EXZIpIsahzU_E01_wrong_execution_1751fde1/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_densestep_A_ds_EXZIpIsahzU_E01_wrong_execution_1751fde1/error_context.mp4",
"correct_clip": "generation_... | {
"sample_id": "v2_dataset_v2_batch3_densestep_A_ds_EXZIpIsahzU_E01_wrong_execution_1751fde1",
"label": "有问题",
"confidence": 0.75,
"error_start_s": 0,
"error_end_s": 2,
"visible_error": "错误地使用了红色毛毡剪裁叶子。",
"difference_from_correct": "正确视频使用绿色毛毡，而错误视频使用了红色毛毡。",
"physics_check": "通过",
"reason": "视频2中使用了红... | {
"source_duration_s": 663.42,
"crop_start_s": 463.26,
"crop_end_s": 583.26,
"duration_s": 120,
"source_replacement_start_s": 523.26,
"source_replacement_end_s": 525.26,
"error_start_s": 60,
"error_end_s": 62,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_densestep_A_ds_EXZIpIsahz... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_densestep_A_ds_EXZIpIsahzU_E01_wrong_execution_1751fde1/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_densestep_A_ds_EXZIpIsahzU_E01_wro... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:43:11.559079+00:00",
"note": ""
} |
v2_dataset_v2_batch3_densestep_A_ds_Ty9p_sDQLf4_E03_substitution_fa033571 | substitution | object_or_predicate_swap | Hot glue Velcro strips to the plastic rectangle. | Apply glue from a glue stick to the Velcro strips and press them onto the plastic rectangle. | A glue stick won't hold on plastic, you need to use the hot glue gun. | The weak bond from the glue stick cannot adhere properly to plastic or fabric, causing the Velcro strip to detach completely the first time it is used. | wrong_state | DenseStep2M/HowTo100M | ds_Ty9p-sDQLf4 | Complete the instructional task correctly | unspecified | false | 4.667 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 3,
"task_impact": 3,
"source_fidelity": 4,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "1280x720",
"generated": "1280x720",
"exact_size_match": true,
"aspect_preserved": true,
"area_ratio": 1
} | passed_lean_gates | <source>/source_videos/densestep/Ty9p-sDQLf4.mp4 | {
"step_index": 272.13,
"want_s": 3.14,
"aligned_source_interval": [
0,
2.9045
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_densestep_A_ds_Ty9p_sDQLf4_E03_substitution_fa033571/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_densestep_A_ds_Ty9p_sDQLf4_E03_substitution_fa033571/error_context.mp4",
"correct_clip": "generation_error/... | {
"sample_id": "v2_dataset_v2_batch3_densestep_A_ds_Ty9p_sDQLf4_E03_substitution_fa033571",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 0,
"error_end_s": 4,
"visible_error": "在视频2中，使用的是白色液体胶水（或普通胶棒）涂抹在黑色魔术贴背面，而不是使用热熔胶枪。",
"difference_from_correct": "视频1中，操作者使用热熔胶枪将热熔胶涂在塑料片上，然后粘上魔术贴；而视频2中，操作者将白色普通... | {
"source_duration_s": 747.03,
"crop_start_s": 212.13,
"crop_end_s": 332.13,
"duration_s": 120,
"source_replacement_start_s": 272.13,
"source_replacement_end_s": 275.27,
"error_start_s": 60,
"error_end_s": 63.14,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_ev... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_densestep_A_ds_Ty9p_sDQLf... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_densestep_A_ds_Ty9p_sDQLf4_E03_substitution_fa033571/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_densestep_A_ds_Ty9p_sDQLf4_E03_substi... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:45:41.597485+00:00",
"note": ""
} |
v2_dataset_v2_batch3_densestep_A_ds_lN3l7RYS2dw_E02_wrong_execution_4427bdc9 | wrong_execution | execution_deviation | Activate Junk Berserker's effect during the battle phase. | Activate Junk Defender's effect during the battle phase. | Wait, you need to activate Junk Berserker's effect, not Junk Defender's! | The wrong effect resolves, leaving the opponent's monster unaffected and causing the player to lose the battle. | wrong_object | DenseStep2M/HowTo100M | ds_lN3l7RYS2dw | Complete the instructional task correctly | unspecified | false | 3.208 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "360x640",
"generated": "720x1280",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 4
} | passed_lean_gates | <source>/source_videos/densestep/lN3l7RYS2dw.mp4 | {
"step_index": 405.11,
"want_s": 2.46,
"aligned_source_interval": [
0,
2.0295
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_densestep_A_ds_lN3l7RYS2dw_E02_wrong_execution_4427bdc9/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_densestep_A_ds_lN3l7RYS2dw_E02_wrong_execution_4427bdc9/error_context.mp4",
"correct_clip": "generation_... | {
"sample_id": "v2_dataset_v2_batch3_densestep_A_ds_lN3l7RYS2dw_E02_wrong_execution_4427bdc9",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 0,
"error_end_s": 2,
"visible_error": "视频2中激活并展示了“垃圾守卫者”的效果，而非“垃圾狂战士”的效果。",
"difference_from_correct": "正确视频激活了垃圾狂战士的效果，而错误视频激活了垃圾守卫者的效果。",
"physics_check": ... | {
"source_duration_s": 761.38,
"crop_start_s": 345.11,
"crop_end_s": 465.11,
"duration_s": 120,
"source_replacement_start_s": 405.11,
"source_replacement_end_s": 407.57,
"error_start_s": 60,
"error_end_s": 62.46,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_ev... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_densestep_A_ds_lN3l7RYS2d... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_densestep_A_ds_lN3l7RYS2dw_E02_wrong_execution_4427bdc9/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_densestep_A_ds_lN3l7RYS2dw_E02_wro... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:46:13.831235+00:00",
"note": ""
} |
v2_dataset_v2_batch3_ego16_A_eel_bee93bfc_E01_substitution_02706d06 | substitution | object_or_predicate_swap | Hold the pot and use a spoon to quickly evaporate the water | Hold the pot and cover it with a lid. | Take the lid off so the water can actually evaporate! | The dish will remain watery and fail to reduce to the desired consistency. | wrong_state | EgoExoLearn | eel_bee93bfc | Complete the kitchen procedure correctly | ego | false | 4.125 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee93bfc-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 239,
"want_s": 2.6,
"aligned_source_interval": [
0,
2.6
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93bfc_E01_substitution_02706d06/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93bfc_E01_substitution_02706d06/error_context.mp4",
"correct_clip": "generation_error/samples/v2_d... | {
"sample_id": "v2_dataset_v2_batch3_ego16_A_eel_bee93bfc_E01_substitution_02706d06",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 0,
"error_end_s": 3,
"visible_error": "在视频2中，操作人员用盖子盖住了锅，而不是像视频1中那样用勺子搅拌以快速蒸发水分。",
"difference_from_correct": "视频1中操作人员手持锅并用勺子搅拌以促进水分蒸发；而视频2中操作人员却用盖子把锅盖上了，这会导致水分无法蒸发。"... | {
"source_duration_s": 665.6,
"crop_start_s": 179,
"crop_end_s": 299,
"duration_s": 120,
"source_replacement_start_s": 239,
"source_replacement_end_s": 241.6,
"error_start_s": 60,
"error_end_s": 62.6,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event_centered... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93bfc_E01_... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93bfc_E01_substitution_02706d06/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93bfc_E01_substitution_02706... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:46:37.090592+00:00",
"note": ""
} |
v2_dataset_v2_batch3_ego16_A_eel_bee93bfc_E02_substitution_553c390d | substitution | object_or_predicate_swap | Use a spoon to scoop an appropriate amount of oil from the bowl | Use a slotted spoon to scoop oil from the bowl. | That's a slotted spoon, the oil will just fall right through it. | The required liquid ingredient is not successfully added to the dish because it leaks through the incorrect tool. | wrong_quantity | EgoExoLearn | eel_bee93bfc | Complete the kitchen procedure correctly | ego | false | 8.208 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee93bfc-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 258.5,
"want_s": 5.702,
"aligned_source_interval": [
0,
5.702
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93bfc_E02_substitution_553c390d/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93bfc_E02_substitution_553c390d/error_context.mp4",
"correct_clip": "generation_error/samples/v2_d... | {
"sample_id": "v2_dataset_v2_batch3_ego16_A_eel_bee93bfc_E02_substitution_553c390d",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 1,
"error_end_s": 6,
"visible_error": "视频2中，操作人员使用漏勺去舀碗里的油，导致油全部从漏勺的孔洞中漏掉，无法成功舀起。",
"difference_from_correct": "视频1中，操作人员使用的是普通的勺子成功舀起并倒入油；而视频2中错误地使用了漏勺，导致液体流失。",
"p... | {
"source_duration_s": 665.6,
"crop_start_s": 198.5,
"crop_end_s": 318.5,
"duration_s": 120,
"source_replacement_start_s": 258.5,
"source_replacement_end_s": 264.202,
"error_start_s": 60,
"error_end_s": 65.702,
"help_point_s": 61,
"duration_status": "within_target",
"continuity_policy": "120s_even... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93bfc_E02_... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93bfc_E02_substitution_553c390d/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93bfc_E02_substitution_553c3... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:46:44.579892+00:00",
"note": ""
} |
v2_dataset_v2_batch3_ego16_A_eel_bee93f44_E01_substitution_39d61ea4 | substitution | object_or_predicate_swap | Hold the kitchen knife to chop the garlic into small pieces | Hold the kitchen knife to chop the onion into small pieces. | Wait, you need to chop the garlic right now, not the onion. | The garlic remains unchopped, and adding onion instead of garlic at this stage will alter the recipe's flavor profile and cooking timing. | wrong_object | EgoExoLearn | eel_bee93f44 | Complete the kitchen procedure correctly | ego | false | 8.292 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee93f44-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 145,
"want_s": 11.4,
"aligned_source_interval": [
0,
11.4
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93f44_E01_substitution_39d61ea4/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93f44_E01_substitution_39d61ea4/error_context.mp4",
"correct_clip": "generation_error/samples/v2_d... | {
"sample_id": "v2_dataset_v2_batch3_ego16_A_eel_bee93f44_E01_substitution_39d61ea4",
"label": "有问题",
"confidence": 1,
"error_start_s": 0,
"error_end_s": 7,
"visible_error": "视频中切的是洋葱，而不是大蒜。",
"difference_from_correct": "正确视频中正在将大蒜切碎，而错误视频中则是在切洋葱。",
"physics_check": "通过",
"reason": "错误视频中切洋葱代替了切大蒜，这与正... | {
"source_duration_s": 610.04,
"crop_start_s": 85,
"crop_end_s": 205,
"duration_s": 120,
"source_replacement_start_s": 145,
"source_replacement_end_s": 156.4,
"error_start_s": 60,
"error_end_s": 71.4,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event_centered... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93f44_E01_... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93f44_E01_substitution_39d61ea4/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93f44_E01_substitution_39d61... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:46:54.548888+00:00",
"note": ""
} |
v2_dataset_v2_batch3_ego16_A_eel_bee93fe4_E02_wrong_execution_f037fb11 | wrong_execution | execution_deviation | Cover the pot lid on top of the pot | Place the serving spoon inside the pot. | Don't forget to put the lid on the pot to keep the heat in. | The food loses too much moisture or fails to cook through properly because the required heat and steam are not trapped. | wrong_state | EgoExoLearn | eel_bee93fe4 | Complete the kitchen procedure correctly | ego | false | 3.167 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee93fe4-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 286.9,
"want_s": 3.4,
"aligned_source_interval": [
0,
2
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93fe4_E02_wrong_execution_f037fb11/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93fe4_E02_wrong_execution_f037fb11/error_context.mp4",
"correct_clip": "generation_error/sample... | {
"sample_id": "v2_dataset_v2_batch3_ego16_A_eel_bee93fe4_E02_wrong_execution_f037fb11",
"label": "有问题",
"confidence": 0.75,
"error_start_s": 0,
"error_end_s": 2,
"visible_error": "未按要求盖上锅盖，而是使用铲子在锅中搅拌。",
"difference_from_correct": "正确动作是盖上锅盖，而错误动作是使用铲子在锅内操作。",
"physics_check": "通过",
"reason": "视频2中未执... | {
"source_duration_s": 618.4,
"crop_start_s": 226.9,
"crop_end_s": 346.9,
"duration_s": 120,
"source_replacement_start_s": 286.9,
"source_replacement_end_s": 290.3,
"error_start_s": 60,
"error_end_s": 63.4,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event_ce... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93fe4_E02_... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93fe4_E02_wrong_execution_f037fb11/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93fe4_E02_wrong_execution... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:47:02.939316+00:00",
"note": ""
} |
v2_dataset_v2_batch3_ego16_A_eel_bee94200_E01_wrong_execution_9de37d8a | wrong_execution | execution_deviation | Hold garlic, peel off skin, throw skin into the garbage bag | Hold garlic, peel off skin, throw skin into the ingredient bowl. | Wait, you just threw the peels into the bowl with the food! | Contaminates the prepared ingredients with waste material, requiring rework to separate them. | wrong_destination | EgoExoLearn | eel_bee94200 | Complete the kitchen procedure correctly | ego | false | 9 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 3,
"action_timing": 4,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee94200-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 111.7,
"want_s": 14.5,
"aligned_source_interval": [
0,
14.5
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94200_E01_wrong_execution_9de37d8a/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94200_E01_wrong_execution_9de37d8a/error_context.mp4",
"correct_clip": "generation_error/sample... | {
"sample_id": "v2_dataset_v2_batch3_ego16_A_eel_bee94200_E01_wrong_execution_9de37d8a",
"label": "有问题",
"confidence": 0.7,
"error_start_s": 5,
"error_end_s": 7,
"visible_error": "剥蒜皮时，将废弃的蒜皮直接扔进了盛有切好葱花的食材盘中。",
"difference_from_correct": "正确步骤应将蒜皮扔进垃圾袋，而视频2将其扔进食材盘，污染了葱花。",
"physics_check": "通过",
"reas... | {
"source_duration_s": 730.4,
"crop_start_s": 51.7,
"crop_end_s": 171.7,
"duration_s": 120,
"source_replacement_start_s": 111.7,
"source_replacement_end_s": 126.2,
"error_start_s": 60,
"error_end_s": 74.5,
"help_point_s": 65,
"duration_status": "within_target",
"continuity_policy": "120s_event_cen... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94200_E01_... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94200_E01_wrong_execution_9de37d8a/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94200_E01_wrong_execution... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:47:11.799671+00:00",
"note": ""
} |
v2_dataset_v2_batch3_ego16_A_eel_bee94570_E03_wrong_execution_c8bc49f8 | wrong_execution | execution_deviation | Hold the pot, hold the oil pot, pour a little oil into the pot | Hold the pot, hold the oil pot, pour a large amount of oil into the pot. | Stop pouring, that's way too much oil! | The dish becomes unpalatably greasy and cooks incorrectly due to being submerged in too much fat. | wrong_quantity | EgoExoLearn | eel_bee94570 | Complete the kitchen procedure correctly | ego | false | 9.833 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee94570-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 439.7,
"want_s": 8.5,
"aligned_source_interval": [
1.4875,
8.5
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94570_E03_wrong_execution_c8bc49f8/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94570_E03_wrong_execution_c8bc49f8/error_context.mp4",
"correct_clip": "generation_error/sample... | {
"sample_id": "v2_dataset_v2_batch3_ego16_A_eel_bee94570_E03_wrong_execution_c8bc49f8",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 3,
"error_end_s": 7,
"visible_error": "向锅中倒入过量食用油，油量过多。",
"difference_from_correct": "视频1仅倒入少量油，视频2持续倾倒大量油。",
"physics_check": "通过",
"reason": "视频2中倒入的油量明显过多，不符合... | {
"source_duration_s": 671.64,
"crop_start_s": 379.7,
"crop_end_s": 499.7,
"duration_s": 120,
"source_replacement_start_s": 439.7,
"source_replacement_end_s": 448.2,
"error_start_s": 60,
"error_end_s": 68.5,
"help_point_s": 63,
"duration_status": "within_target",
"continuity_policy": "120s_event_c... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94570_E03_... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94570_E03_wrong_execution_c8bc49f8/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94570_E03_wrong_execution... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:47:35.968471+00:00",
"note": ""
} |
v2_dataset_v2_batch3_ego16_A_eel_bee9470a_E02_substitution_e43d6cb7 | substitution | object_or_predicate_swap | Press the ginger and slice it into pieces with the knife | Press the garlic and slice it into pieces with the knife. | Wait, you're supposed to be slicing the ginger right now, not the garlic. | The wrong aromatic will be added to the dish, altering the intended flavor profile, while the required ginger is missing. | wrong_object | EgoExoLearn | eel_bee9470a | Complete the kitchen procedure correctly | ego | false | 7.708 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee9470a-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 222.4,
"want_s": 4.8,
"aligned_source_interval": [
0,
4.8
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee9470a_E02_substitution_e43d6cb7/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee9470a_E02_substitution_e43d6cb7/error_context.mp4",
"correct_clip": "generation_error/samples/v2_d... | {
"sample_id": "v2_dataset_v2_batch3_ego16_A_eel_bee9470a_E02_substitution_e43d6cb7",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 0,
"error_end_s": 7,
"visible_error": "视频2中切的是大蒜，而不是生姜。",
"difference_from_correct": "视频1中正确地切了生姜，而视频2中错误地切了大蒜。",
"physics_check": "通过",
"reason": "视频2中使用了错误的食材（大蒜... | {
"source_duration_s": 965.84,
"crop_start_s": 162.4,
"crop_end_s": 282.4,
"duration_s": 120,
"source_replacement_start_s": 222.4,
"source_replacement_end_s": 227.2,
"error_start_s": 60,
"error_end_s": 64.8,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event_c... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_ego16_A_eel_bee9470a_E02_... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee9470a_E02_substitution_e43d6cb7/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee9470a_E02_substitution_e43d6... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:48:00.173033+00:00",
"note": ""
} |
v2_dataset_v2_batch3_ego16_A_eel_bee94944_E01_wrong_execution_f9e29d78 | wrong_execution | execution_deviation | Hold the bowl and use the chopsticks to thoroughly stir the eggs until beaten | Hold the bowl and use the chopsticks to stir along the inner rim of the bowl, leaving the egg yolks unbroken. | Make sure to break the yolks and mix it all together, not just stir around the edges. | Failing to beat the eggs prevents them from forming a uniform structure when cooked, ruining the intended texture and appearance of the dish. | wrong_state | EgoExoLearn | eel_bee94944 | Complete the kitchen procedure correctly | ego | false | 9.708 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee94944-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 239.6,
"want_s": 7.4,
"aligned_source_interval": [
1.295,
7.4
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94944_E01_wrong_execution_f9e29d78/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94944_E01_wrong_execution_f9e29d78/error_context.mp4",
"correct_clip": "generation_error/sample... | {
"sample_id": "v2_dataset_v2_batch3_ego16_A_eel_bee94944_E01_wrong_execution_f9e29d78",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 0,
"error_end_s": 6,
"visible_error": "筷子仅沿碗壁搅拌，未戳破或打散蛋黄。",
"difference_from_correct": "正确动作中蛋液已完全打散混合，而此版本中蛋黄保持完整未破。",
"physics_check": "通过",
"reason": "视频2中未将蛋... | {
"source_duration_s": 653.48,
"crop_start_s": 179.6,
"crop_end_s": 299.6,
"duration_s": 120,
"source_replacement_start_s": 239.6,
"source_replacement_end_s": 247,
"error_start_s": 60,
"error_end_s": 67.4,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event_cen... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94944_E01_... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94944_E01_wrong_execution_f9e29d78/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94944_E01_wrong_execution... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:50:31.824672+00:00",
"note": ""
} |
v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E01_wrong_execution_2d602cb1 | wrong_execution | execution_deviation | Press on the green pepper and cut it into large pieces with a knife | Press on the red pepper and cut it into large pieces with a meat cleaver. | Wait, you need the green pepper for this, and a regular knife is much easier to use than that heavy cleaver! | The wrong ingredient is added to the meal, failing to follow the recipe's specific flavor requirements. | wrong_object | EgoExoLearn | eel_bee94a02 | Complete the kitchen procedure correctly | ego | false | 9 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee94a02-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 4.4,
"want_s": 11.2,
"aligned_source_interval": [
0,
11.2
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E01_wrong_execution_2d602cb1/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E01_wrong_execution_2d602cb1/error_context.mp4",
"correct_clip": "generation_error/sample... | {
"sample_id": "v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E01_wrong_execution_2d602cb1",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 0,
"error_end_s": 8,
"visible_error": "使用红椒代替绿椒，并用大菜刀进行切块。",
"difference_from_correct": "视频1切绿椒，视频2切红椒且工具不同。",
"physics_check": "通过",
"reason": "视频2中食材和刀具选择错误，不符... | {
"source_duration_s": 901.28,
"crop_start_s": 0,
"crop_end_s": 120,
"duration_s": 120,
"source_replacement_start_s": 4.4,
"source_replacement_end_s": 15.6,
"error_start_s": 4.4,
"error_end_s": 15.6,
"help_point_s": 4.4,
"duration_status": "within_target",
"continuity_policy": "120s_event_centered... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E01_... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E01_wrong_execution_2d602cb1/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E01_wrong_execution... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:50:48.750306+00:00",
"note": ""
} |
v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E02_wrong_execution_9cdd19d7 | wrong_execution | execution_deviation | Press the green pepper, hold a knife, cut the green pepper into large pieces, and place them on one side of the cutting board for later use | Press the red pepper, hold a knife, cut the red pepper into large pieces, and place them on one side of the cutting board for later use. | That's the red pepper, you need to cut the green one right now. | The green pepper is not ready when needed for the next cooking step, delaying the process or causing it to be omitted. | wrong_object | EgoExoLearn | eel_bee94a02 | Complete the kitchen procedure correctly | ego | false | 9.833 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee94a02-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 24,
"want_s": 11,
"aligned_source_interval": [
0,
11
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E02_wrong_execution_9cdd19d7/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E02_wrong_execution_9cdd19d7/error_context.mp4",
"correct_clip": "generation_error/sample... | {
"sample_id": "v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E02_wrong_execution_9cdd19d7",
"label": "有问题",
"confidence": 0.7,
"error_start_s": 0,
"error_end_s": 9,
"visible_error": "视频2中切的是红椒，而不是绿椒。",
"difference_from_correct": "正确步骤应该切绿椒，而视频2中错误地切了红椒。",
"physics_check": "通过",
"reason": "视频2中切红椒的动作清晰可见，... | {
"source_duration_s": 901.28,
"crop_start_s": 0,
"crop_end_s": 120,
"duration_s": 120,
"source_replacement_start_s": 24,
"source_replacement_end_s": 35,
"error_start_s": 24,
"error_end_s": 35,
"help_point_s": 24,
"duration_status": "within_target",
"continuity_policy": "120s_event_centered",
"e... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E02_... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E02_wrong_execution_9cdd19d7/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E02_wrong_execution... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:51:09.911499+00:00",
"note": ""
} |
v2_dataset_v2_batch3_ego16_A_eel_bee94b7e_E01_wrong_execution_ec8c2fca | wrong_execution | execution_deviation | Press the green pepper on the cutting board | Press the green pepper on the bare kitchen counter. | Move that pepper onto the cutting board before you press it! | Food contamination due to direct contact with an unsanitized countertop surface. | wrong_destination | EgoExoLearn | eel_bee94b7e | Complete the kitchen procedure correctly | ego | false | 7.458 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 3,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee94b7e-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 79.9,
"want_s": 8.3,
"aligned_source_interval": [
0,
8.3
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94b7e_E01_wrong_execution_ec8c2fca/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94b7e_E01_wrong_execution_ec8c2fca/error_context.mp4",
"correct_clip": "generation_error/sample... | {
"sample_id": "v2_dataset_v2_batch3_ego16_A_eel_bee94b7e_E01_wrong_execution_ec8c2fca",
"label": "有问题",
"confidence": 0.7,
"error_start_s": 1,
"error_end_s": 6,
"visible_error": "操作者将青椒放在裸露的厨房台面上进行切压，而非砧板上。",
"difference_from_correct": "视频1在砧板上切青椒，视频2在砧板旁的台面上切青椒。",
"physics_check": "通过",
"reason": "视... | {
"source_duration_s": 655.24,
"crop_start_s": 19.9,
"crop_end_s": 139.9,
"duration_s": 120,
"source_replacement_start_s": 79.9,
"source_replacement_end_s": 88.2,
"error_start_s": 60,
"error_end_s": 68.3,
"help_point_s": 61,
"duration_status": "within_target",
"continuity_policy": "120s_event_cent... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94b7e_E01_... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94b7e_E01_wrong_execution_ec8c2fca/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94b7e_E01_wrong_execution... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:51:46.595030+00:00",
"note": ""
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_cmu_bike05_2_E01_substitution_0204ef5a | substitution | object_or_predicate_swap | Loosen both axle nuts using a wrench | Loosen both axle nuts using a pair of pliers. | Stop, you're going to strip the nut with those pliers, use a proper wrench. | Stripping the axle nut makes it impossible to remove with standard tools, preventing the wheel from being taken off. | wrong_state | EgoExo4D | ee4d_cmu_bike05_2 | Complete the Remove a Wheel correctly | ego | false | 10 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 3,
"action_timing": 4,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/cmu_bike05_2/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 5.273,
"want_s": 13.47,
"aligned_source_interval": [
0,
13.47
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_cmu_bike05_2_E01_substitution_0204ef5a/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_cmu_bike05_2_E01_substitution_0204ef5a/error_context.mp4",
"correct_clip": "generation_er... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_cmu_bike05_2_E01_substitution_0204ef5a",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 2,
"error_end_s": 9,
"visible_error": "视频2中，操作者使用钳子（pliers）来拧松车轴螺母，而不是使用合适的开口扳手或套筒扳手。",
"difference_from_correct": "视频1中，操作者使用合适的扳手安全地拧松车轴螺母；而视频2中，操作者错误地使用钳子去拧... | {
"source_duration_s": 33.2,
"crop_start_s": 0,
"crop_end_s": 33.2,
"duration_s": 33.2,
"source_replacement_start_s": 5.273,
"source_replacement_end_s": 18.743,
"error_start_s": 5.273,
"error_end_s": 18.743,
"help_point_s": 7.273,
"duration_status": "short_source",
"continuity_policy": "full_sourc... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_cmu_bike0... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_cmu_bike05_2_E01_substitution_0204ef5a/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_cmu_bike05_2_E01_su... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:52:26.607707+00:00",
"note": ""
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_02_3_E01_substitution_a7581566 | substitution | object_or_predicate_swap | Get a new inner tube | Pick up the old, punctured inner tube. | You grabbed the old flat tube, use the new one. | The punctured tube will not hold air when inflated, rendering the bike unrideable. | wrong_object | EgoExo4D | ee4d_fair_bike_02_3 | Complete the Fix a Flat Tire - Replace a Bike Tube correctly | ego | false | 5.667 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 3,
"motion_coherence": 4,
"visual_quality": 3
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/fair_bike_02_3/frame_aligned_videos/downscaled/448/aria02_214-1.mp4 | {
"step_index": 259.84,
"want_s": 10.911,
"aligned_source_interval": [
0,
10.911
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_02_3_E01_substitution_a7581566/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_02_3_E01_substitution_a7581566/error_context.mp4",
"correct_clip": "generatio... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_02_3_E01_substitution_a7581566",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 1,
"error_end_s": 5,
"visible_error": "操作人员从地上捡起了一个旧的、已经漏气的内胎，而不是像视频1那样从桌上拿取全新的、卷好的内胎。",
"difference_from_correct": "视频1中，操作人员从桌上拿取并展开全新的内胎；而视频2中，操作人员直接从地上捡起... | {
"source_duration_s": 495.43,
"crop_start_s": 199.84,
"crop_end_s": 319.84,
"duration_s": 120,
"source_replacement_start_s": 259.84,
"source_replacement_end_s": 270.751,
"error_start_s": 60,
"error_end_s": 70.911,
"help_point_s": 61,
"duration_status": "within_target",
"continuity_policy": "120s_... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_02_3_E01_substitution_a7581566/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_02_3_E0... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:53:19.169852+00:00",
"note": ""
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_02_8_E01_substitution_78cc9e44 | substitution | object_or_predicate_swap | Tighten both axle nuts using a wrench | Tighten both axle nuts by hand. | You need to use a wrench to tighten those down properly, hand-tight isn't enough. | The wheel will vibrate loose and potentially fall off during use due to insufficient torque on the axle nuts. | wrong_state | EgoExo4D | ee4d_fair_bike_02_8 | Complete the Install a Wheel correctly | ego | false | 10 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/fair_bike_02_8/frame_aligned_videos/downscaled/448/aria02_214-1.mp4 | {
"step_index": 27.715,
"want_s": 11.732,
"aligned_source_interval": [
0,
11.732
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_02_8_E01_substitution_78cc9e44/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_02_8_E01_substitution_78cc9e44/error_context.mp4",
"correct_clip": "generatio... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_02_8_E01_substitution_78cc9e44",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 0,
"error_end_s": 9,
"visible_error": "操作人员仅用手拧紧两侧的轴螺母，没有使用扳手进行加固。",
"difference_from_correct": "在正确视频中，操作人员使用扳手将两侧的轴螺母牢固拧紧；而在错误视频中，操作人员仅用手拧紧，未达到安全扭矩。",
"p... | {
"source_duration_s": 141.47,
"crop_start_s": 0,
"crop_end_s": 141.47,
"duration_s": 141.47,
"source_replacement_start_s": 27.715,
"source_replacement_end_s": 39.447,
"error_start_s": 27.715,
"error_end_s": 39.447,
"help_point_s": 27.715,
"duration_status": "within_target",
"continuity_policy": "... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_02_8_E01_substitution_78cc9e44/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_02_8_E0... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:53:27.626008+00:00",
"note": ""
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_18_E01_substitution_3a5bfb84 | substitution | object_or_predicate_swap | Get appropriate wrenches | Get a standard combination wrench. | That wrench won't work on tires, you need to grab the lug wrench. | The tool will not fit the lug nuts, making it impossible to remove the wheel and halting the task. | wrong_object | EgoExo4D | ee4d_fair_bike_06_18 | Complete the Remove a Wheel correctly | ego | false | 5.083 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/fair_bike_06_18/frame_aligned_videos/downscaled/448/aria06_214-1.mp4 | {
"step_index": 21.796,
"want_s": 5.123,
"aligned_source_interval": [
1.921125,
5.123
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_18_E01_substitution_3a5bfb84/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_18_E01_substitution_3a5bfb84/error_context.mp4",
"correct_clip": "generat... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_18_E01_substitution_3a5bfb84",
"label": "有问题",
"confidence": 0.9,
"error_start_s": 0,
"error_end_s": 4,
"visible_error": "视频2中展示并使用的是普通的梅花开口两用扳手，而不是视频1中使用的T型套筒扳手。",
"difference_from_correct": "视频1中拿取并使用的是T型套筒扳手，而视频2中拿取的是普通的梅花开口两用扳手。",
"ph... | {
"source_duration_s": 45.67,
"crop_start_s": 0,
"crop_end_s": 45.67,
"duration_s": 45.67,
"source_replacement_start_s": 21.796,
"source_replacement_end_s": 26.919,
"error_start_s": 21.796,
"error_end_s": 26.919,
"help_point_s": 21.796,
"duration_status": "short_source",
"continuity_policy": "full... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_18_E01_substitution_3a5bfb84/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_18_... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:53:40.061543+00:00",
"note": ""
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_19_E01_wrong_execution_aa1ee255 | wrong_execution | execution_deviation | Fit the tire to the wheel | Push the tire bead onto the wheel rim, leaving a section of the inner tube pinched outside the rim. | Stop, you need to tuck that piece of the tube inside before seating the tire! | The pinched tube will rupture upon inflation, failing the task of fixing the flat tire. | wrong_state | EgoExo4D | ee4d_fair_bike_06_19 | Complete the Fix a Flat Tire - Replace a Bike Tube correctly | ego | false | 6.5 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/fair_bike_06_19/frame_aligned_videos/downscaled/448/aria06_214-1.mp4 | {
"step_index": 72.867,
"want_s": 10.908,
"aligned_source_interval": [
2.9997000000000003,
10.908
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_19_E01_wrong_execution_aa1ee255/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_19_E01_wrong_execution_aa1ee255/error_context.mp4",
"correct_clip": "g... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_19_E01_wrong_execution_aa1ee255",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 1,
"error_end_s": 6,
"visible_error": "在安装外胎时，内胎的一部分被夹在外胎和轮毂边缘之间，露在外面。",
"difference_from_correct": "正确视频中，内胎被完全塞入外胎内部；而错误视频中，内胎有一截露在外面并被外胎边缘夹住。",
"phys... | {
"source_duration_s": 155.5,
"crop_start_s": 0,
"crop_end_s": 155.5,
"duration_s": 155.5,
"source_replacement_start_s": 72.867,
"source_replacement_end_s": 83.775,
"error_start_s": 72.867,
"error_end_s": 83.775,
"help_point_s": 73.867,
"duration_status": "within_target",
"continuity_policy": "ful... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_19_E01_wrong_execution_aa1ee255/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:53:50.320077+00:00",
"note": ""
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_07_10_E01_substitution_0f20c1df | substitution | object_or_predicate_swap | Loosen both axle nuts using a wrench | Loosen both axle nuts using a pair of pliers. | Stop, you're going to strip the nut with those pliers, use a proper wrench. | Stripping the axle nut makes it impossible to remove with standard tools, preventing the wheel from being taken off. | wrong_state | EgoExo4D | ee4d_fair_bike_07_10 | Complete the Remove a Wheel correctly | ego | false | 10 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/fair_bike_07_10/frame_aligned_videos/downscaled/448/aria07_214-1.mp4 | {
"step_index": 19.058,
"want_s": 10.443,
"aligned_source_interval": [
0,
10.443
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_07_10_E01_substitution_0f20c1df/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_07_10_E01_substitution_0f20c1df/error_context.mp4",
"correct_clip": "generat... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_07_10_E01_substitution_0f20c1df",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 1,
"error_end_s": 9,
"visible_error": "操作员使用钳子（pliers）来松开车轴螺母，而不是使用合适的扳手（wrench）。",
"difference_from_correct": "在视频1中，操作员使用扳手正确地松开两侧的轴螺母；而在视频2中，操作员改用钳子来夹持并试... | {
"source_duration_s": 41.43,
"crop_start_s": 0,
"crop_end_s": 41.43,
"duration_s": 41.43,
"source_replacement_start_s": 19.058,
"source_replacement_end_s": 29.501,
"error_start_s": 19.058,
"error_end_s": 29.501,
"help_point_s": 20.058,
"duration_status": "short_source",
"continuity_policy": "full... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_07_10_E01_substitution_0f20c1df/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_07_10_... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T07:54:17.642457+00:00",
"note": ""
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_09_6_E01_wrong_execution_ac853f32 | wrong_execution | execution_deviation | Pull the inner tube out | Attach a pump to the valve and inflate the flat inner tube. | Don't pump it up now, you need to pull the old tube out first! | The old tube occupies the space needed for the new tube, halting the replacement process. | off_step | EgoExo4D | ee4d_fair_bike_09_6 | Complete the Fix a Flat Tire - Replace a Bike Tube correctly | ego | false | 6.625 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/fair_bike_09_6/frame_aligned_videos/downscaled/448/aria03_214-1.mp4 | {
"step_index": 25.336,
"want_s": 10.305,
"aligned_source_interval": [
0,
5.410125
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_09_6_E01_wrong_execution_ac853f32/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_09_6_E01_wrong_execution_ac853f32/error_context.mp4",
"correct_clip": "gen... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_09_6_E01_wrong_execution_ac853f32",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 0,
"error_end_s": 6,
"visible_error": "操作者在应该拔出旧内胎时，却使用气枪连接气门嘴并开始充气。",
"difference_from_correct": "正确动作是直接将旧内胎从车胎中拉出，而错误动作是试图给旧内胎充气。",
"physics_check": "... | {
"source_duration_s": 335.43,
"crop_start_s": 0,
"crop_end_s": 120,
"duration_s": 120,
"source_replacement_start_s": 25.336,
"source_replacement_end_s": 35.641,
"error_start_s": 25.336,
"error_end_s": 35.641,
"help_point_s": 25.336,
"duration_status": "within_target",
"continuity_policy": "120s_e... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_09_6_E01_wrong_execution_ac853f32/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_09_6... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T08:51:29.437952+00:00",
"note": ""
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_10_2_E01_wrong_execution_2c3c62bd | wrong_execution | execution_deviation | Pull back and lift the bead out of the rim | Push the tire bead down into the center of the rim instead of lifting it out. | You need to pry the bead up and over the outside of the rim now, not push it back in. | The tire cannot be removed from the wheel, preventing the user from reaching the punctured tube. | wrong_state | EgoExo4D | ee4d_fair_bike_10_2 | Complete the Fix a Flat Tire - Replace a Bike Tube correctly | ego | false | 9.125 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/fair_bike_10_2/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 18.483,
"want_s": 9.855,
"aligned_source_interval": [
2.710125,
9.855
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_10_2_E01_wrong_execution_2c3c62bd/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_10_2_E01_wrong_execution_2c3c62bd/error_context.mp4",
"correct_clip": "gen... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_10_2_E01_wrong_execution_2c3c62bd",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 1,
"error_end_s": 8,
"visible_error": "操作者将胎唇向下推入轮圈中心，而非向上拉出轮圈。",
"difference_from_correct": "视频1向后拉并提起胎唇；视频2向下按压胎唇。",
"physics_check": "通过",
"reason":... | {
"source_duration_s": 320.57,
"crop_start_s": 0,
"crop_end_s": 120,
"duration_s": 120,
"source_replacement_start_s": 18.483,
"source_replacement_end_s": 28.338,
"error_start_s": 18.483,
"error_end_s": 28.338,
"help_point_s": 19.483,
"duration_status": "within_target",
"continuity_policy": "120s_e... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_10_2_E01_wrong_execution_2c3c62bd/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_10_2... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "chengzhi.ucsb",
"reviewed_at": "2026-08-25T08:51:41.834054+00:00",
"note": ""
} |
End of preview. Expand in Data Studio
UPBench-Error-verified
人工核验过的 LCZZZZ/UPBench-Error → generation_error 子集。
保留其中看不出明显低级生成缺陷的样本。
这是怎么筛出来的
从原数据集 5,761 条 generation_error 样本出发：
| 步骤 | 剩余 |
|---|---|
| 原始样本 | 5,761 |
剔除 is_gui=true（GUI-World / egoproactive 屏幕录制） |
3,390 |
逐条人工过目 error_clip.mp4 |
3,390 全部看完 |
| 判定为无明显生成缺陷（good） | 1,420 |
| 判定为有缺陷（bad） | 1,970 |
内容
metadata/manifest-verified.jsonl 1,420 条，原 manifest 字段逐字保留，
另加 human_verification 字段
metadata/human_labels_all.csv 3,390 条全量标注（含 bad），可复现筛选
metadata/summary.json 统计摘要
videos/<sample_id>/
error_clip.mp4 AI 生成的错误片段
error_context.mp4 完整上下文：真实前段 + 尾部生成段
correct_clip.mp4 配对的正确片段（真实拍摄）
correct_context.mp4 配对的完整上下文（全程真实）
每个样本四个视频齐全，与原数据集 generation_error 的结构一致。
human_verification 字段：
{"label": "good",
"meaning": "no obvious low-level generation artifact",
"reviewer": "...", "reviewed_at": "...", "note": ""}
其余所有字段（error_type / correct_step / error_step /
expected_correction / failure_mechanism / audit / pair …）
均与原数据集逐字一致，未做任何改写或翻译。
good 子集构成
| error_type | 数量 |
|---|---|
| wrong_execution | 820 |
| substitution | 600 |
| 上游数据集 | 数量 |
|---|---|
| EgoExo4D | 643 |
| EgoExoLearn | 528 |
| ENIGMA-360 | 50 |
| EgoLife | 37 |
| egoproactive | 36 |
| 其余 10 个来源 | 126 |
许可
沿用原数据集的 source-dataset-terms。素材来自 EgoExo4D、EgoExoLearn、
ENIGMA-360、HoloAssist 等上游数据集，各自的使用协议依然适用。
使用前请确认你已获得相应上游数据集的授权。
- Downloads last month
- -