Datasets:
sample_id stringlengths 59 120 | error_type stringclasses 2
values | error_family stringclasses 2
values | correct_step stringlengths 6 170 | error_step stringlengths 11 172 | expected_correction stringlengths 29 144 | failure_mechanism stringlengths 48 216 | consequence_category stringclasses 66
values | dataset stringclasses 17
values | take_name stringlengths 8 48 | scenario stringclasses 65
values | view stringclasses 3
values | is_gui bool 1
class | duration_s float64 2.46 10 | dimension_scores dict | geometry dict | reason_code stringclasses 2
values | source_video stringlengths 44 146 | temporal dict | files dict | audit dict | pair dict | category stringclasses 1
value | provenance dict | _source_files dict | human_verification dict |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
v2_ab_letterbox_arm_B_ee4d_cmu_bike18_3_E01_wrong_execution_ab2e235d | wrong_execution | execution_deviation | Get bike tire lever | Get a flathead screwdriver. | Don't use a screwdriver, you'll pinch the tube—get a proper tire lever. | The sharp metal tip of the screwdriver will puncture the inner tube when prying the tire, ruining the repair and causing another flat. | wrong_object | EgoExo4D | ee4d_cmu_bike18_3 | Complete the Fix a Flat Tire - Replace a Bike Tube correctly | ego | false | 3.167 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/cmu_bike18_3/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 34.065,
"want_s": 3.258,
"aligned_source_interval": [
1.258,
3.258
]
} | {
"correct_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_cmu_bike18_3_E01_wrong_execution_ab2e235d/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_cmu_bike18_3_E01_wrong_execution_ab2e235d/error_context.mp4",
"correct_clip": "generation_error/samples/v2... | {
"sample_id": "v2_ab_letterbox_arm_B_ee4d_cmu_bike18_3_E01_wrong_execution_ab2e235d",
"label": "有问题",
"confidence": 0.7,
"error_start_s": 0,
"error_end_s": 2,
"visible_error": "操作者从工具包中拿出了一个一字螺丝刀，而非专业的自行车撬胎棒。",
"difference_from_correct": "正确动作应使用塑料撬胎棒以防损坏内胎，而视频2中错误地选择了金属一字螺丝刀。",
"physics_check": "通过",
... | {
"source_duration_s": 135.47,
"crop_start_s": 0,
"crop_end_s": 135.47,
"duration_s": 135.47,
"source_replacement_start_s": 34.065,
"source_replacement_end_s": 37.323,
"error_start_s": 34.065,
"error_end_s": 37.323,
"help_point_s": 34.065,
"duration_status": "within_target",
"continuity_policy": "... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_letterbox_arm_B_ee4d_cmu_bike18_3_E01_wr... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_cmu_bike18_3_E01_wrong_execution_ab2e235d/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_cmu_bike18_3_E01_wrong_execution_ab2... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T04:53:41.344360+00:00"
} |
v2_ab_letterbox_arm_B_ee4d_georgiatech_covid_09_10_E01_wrong_execution_27102718 | wrong_execution | execution_deviation | Dip the swab into the testing tube | Rub the swab directly onto the sample well of the test cassette. | Wait, you need to mix the swab in the tube's liquid first! | Without the buffer liquid, the sample cannot flow across the test membrane via capillary action, resulting in an invalid test. | wrong_destination | EgoExo4D | ee4d_georgiatech_covid_09_10 | Complete the Covid-19 Rapid Antigen Test correctly | ego | false | 5 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/georgiatech_covid_09_10/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 135.148,
"want_s": 7.482,
"aligned_source_interval": [
4.30215,
7.482
]
} | {
"correct_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_georgiatech_covid_09_10_E01_wrong_execution_27102718/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_georgiatech_covid_09_10_E01_wrong_execution_27102718/error_context.mp4",
"correct_clip": "gener... | {
"sample_id": "v2_ab_letterbox_arm_B_ee4d_georgiatech_covid_09_10_E01_wrong_execution_27102718",
"label": "有问题",
"confidence": 0.75,
"error_start_s": 0,
"error_end_s": 4,
"visible_error": "直接用棉签涂抹测试卡槽，未先浸入试管中。",
"difference_from_correct": "正确操作需先将棉签与试管液体混合，视频2直接涂抹卡槽。",
"physics_check": "通过",
"reason"... | {
"source_duration_s": 276.77,
"crop_start_s": 75.148,
"crop_end_s": 195.148,
"duration_s": 120,
"source_replacement_start_s": 135.148,
"source_replacement_end_s": 142.63,
"error_start_s": 60,
"error_end_s": 67.482,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_letterbox_arm_B_ee4d_georgiatech_covid_0... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_georgiatech_covid_09_10_E01_wrong_execution_27102718/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_georgiatech_covid_09_10_E... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T04:59:00.444984+00:00"
} |
v2_ab_letterbox_arm_B_ee4d_iiith_cooking_05_1_E01_substitution_1645c8a7 | substitution | object_or_predicate_swap | Place the skillet or pan or pot on the stove | Place the pot on the counter next to the stove. | You need to put the pot on the stove, not leave it on the counter. | When the stove is turned on in a subsequent step, it will heat an empty burner while the pot on the counter remains cold, preventing the milk tea from brewing. | wrong_destination | EgoExo4D | ee4d_iiith_cooking_05_1 | Complete the Making Milk Tea correctly | ego | false | 3.542 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/iiith_cooking_05_1/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 62.41,
"want_s": 2.374,
"aligned_source_interval": [
0,
2.19595
]
} | {
"correct_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_05_1_E01_substitution_1645c8a7/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_05_1_E01_substitution_1645c8a7/error_context.mp4",
"correct_clip": "generation_error/samp... | {
"sample_id": "v2_ab_letterbox_arm_B_ee4d_iiith_cooking_05_1_E01_substitution_1645c8a7",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 0,
"error_end_s": 3.5,
"visible_error": "视频2中，红色的奶锅被放置在灶台旁的台面上，而非燃气灶上。",
"difference_from_correct": "视频1将奶锅放在灶上，视频2将奶锅放在台面上，导致无法加热。",
"physics_check": "通过",
"re... | {
"source_duration_s": 236.47,
"crop_start_s": 2.41,
"crop_end_s": 122.41,
"duration_s": 120,
"source_replacement_start_s": 62.41,
"source_replacement_end_s": 64.784,
"error_start_s": 60,
"error_end_s": 62.374,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_even... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_05_1_... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_05_1_E01_substitution_1645c8a7/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_05_1_E01_substituti... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T04:59:06.001095+00:00"
} |
v2_ab_letterbox_arm_B_ee4d_iiith_cooking_123_6_E01_substitution_3dd88139 | substitution | object_or_predicate_swap | Adjust the stove heat | Turn the knob for the adjacent empty burner. | You're turning the wrong knob, that's for the empty burner! | The milk tea boils over or scorches because the heat was not properly reduced, ruining the beverage. | wrong_object | EgoExo4D | ee4d_iiith_cooking_123_6 | Complete the Making Milk Tea correctly | ego | false | 5.583 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/iiith_cooking_123_6/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 1.575,
"want_s": 3.496,
"aligned_source_interval": [
0,
3.496
]
} | {
"correct_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_123_6_E01_substitution_3dd88139/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_123_6_E01_substitution_3dd88139/error_context.mp4",
"correct_clip": "generation_error/sa... | {
"sample_id": "v2_ab_letterbox_arm_B_ee4d_iiith_cooking_123_6_E01_substitution_3dd88139",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 1,
"error_end_s": 5,
"visible_error": "操作者没有调节放有奶茶锅的左侧炉灶旋钮，而是旋转了右侧空炉灶的旋钮，导致右侧空炉灶起火。",
"difference_from_correct": "正确动作中，操作者调节的是放有锅具的左侧炉灶旋钮；而错误动作中，操作者错误地调节了右侧空炉灶的旋... | {
"source_duration_s": 158.27,
"crop_start_s": 0,
"crop_end_s": 158.27,
"duration_s": 158.27,
"source_replacement_start_s": 1.575,
"source_replacement_end_s": 5.071,
"error_start_s": 1.575,
"error_end_s": 5.071,
"help_point_s": 2.575,
"duration_status": "within_target",
"continuity_policy": "full_... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_123_6... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_123_6_E01_substitution_3dd88139/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_123_6_E01_substitu... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T04:59:36.892160+00:00"
} |
v2_ab_letterbox_arm_B_ee4d_iiith_cooking_130_4_E04_wrong_execution_1f079552 | wrong_execution | execution_deviation | Lift the lid of a skillet or pan or pot | Lift the entire covered skillet off the burner and set it aside. | Leave the pan on the stove and just take the lid off. | The cooking process halts prematurely because the pan is off the heat, and the next ingredients cannot be added because the lid is still blocking the pan. | off_step | EgoExo4D | ee4d_iiith_cooking_130_4 | Complete the Cooking Tomato & Eggs correctly | ego | false | 4.083 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 3,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/iiith_cooking_130_4/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 312.981,
"want_s": 4.136,
"aligned_source_interval": [
1.5510000000000002,
4.136
]
} | {
"correct_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_130_4_E04_wrong_execution_1f079552/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_130_4_E04_wrong_execution_1f079552/error_context.mp4",
"correct_clip": "generation_er... | {
"sample_id": "v2_ab_letterbox_arm_B_ee4d_iiith_cooking_130_4_E04_wrong_execution_1f079552",
"label": "有问题",
"confidence": 0.7,
"error_start_s": 0,
"error_end_s": 3,
"visible_error": "操作者将整个带盖的平底锅移离炉灶并置于一旁，而非仅取下锅盖。",
"difference_from_correct": "视频1仅揭开锅盖，锅仍在炉上；视频2则将整个带盖锅具移走。",
"physics_check": "通过",
"... | {
"source_duration_s": 347.37,
"crop_start_s": 227.37,
"crop_end_s": 347.37,
"duration_s": 120,
"source_replacement_start_s": 312.981,
"source_replacement_end_s": 317.117,
"error_start_s": 85.611,
"error_end_s": 89.747,
"help_point_s": 85.611,
"duration_status": "within_target",
"continuity_policy... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_130_4... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_130_4_E04_wrong_execution_1f079552/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_130_4_E04_wrong... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T04:59:54.107488+00:00"
} |
v2_ab_letterbox_arm_B_ee4d_iiith_cooking_25_3_E01_wrong_execution_77924fa7 | wrong_execution | execution_deviation | Add onion powder to a mixing bowl | Sprinkle the onion powder onto the cutting board instead of into the mixing bowl. | You're sprinkling the powder on the board instead of in the bowl! | The seasoning fails to reach the salad mixture, resulting in an incorrectly flavored dish. | wrong_destination | EgoExo4D | ee4d_iiith_cooking_25_3 | Complete the Making Cucumber & Tomato Salad correctly | ego | false | 5.208 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 3,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/iiith_cooking_25_3/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 84.114,
"want_s": 4.306,
"aligned_source_interval": [
0.32294999999999996,
3.55245
]
} | {
"correct_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_25_3_E01_wrong_execution_77924fa7/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_25_3_E01_wrong_execution_77924fa7/error_context.mp4",
"correct_clip": "generation_erro... | {
"sample_id": "v2_ab_letterbox_arm_B_ee4d_iiith_cooking_25_3_E01_wrong_execution_77924fa7",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 1,
"error_end_s": 3,
"visible_error": "洋葱粉被撒在砧板上而非碗中。",
"difference_from_correct": "正确步骤应将粉末加入碗内，错误步骤将其撒在砧板上。",
"physics_check": "通过",
"reason": "视频2中明显可见调料被... | {
"source_duration_s": 111.8,
"crop_start_s": 0,
"crop_end_s": 111.8,
"duration_s": 111.8,
"source_replacement_start_s": 84.114,
"source_replacement_end_s": 88.42,
"error_start_s": 84.114,
"error_end_s": 88.42,
"help_point_s": 85.114,
"duration_status": "within_target",
"continuity_policy": "full_... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_25_3_... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_25_3_E01_wrong_execution_77924fa7/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_iiith_cooking_25_3_E01_wrong_e... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:00:00.951846+00:00"
} |
v2_ab_letterbox_arm_B_ee4d_sfu_cooking023_6_E01_wrong_execution_4014446b | wrong_execution | execution_deviation | Pour egg mixture into a skillet | Pour the egg mixture down the sink drain. | Stop, don't pour the eggs down the sink! | The eggs are lost down the drain, leaving nothing to scramble. | wrong_destination | EgoExo4D | ee4d_sfu_cooking023_6 | Complete the Cooking Scrambled Eggs correctly | ego | false | 6.333 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 3,
"action_timing": 4,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/sfu_cooking023_6/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 48.056,
"want_s": 3.949,
"aligned_source_interval": [
0,
3.949
]
} | {
"correct_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_sfu_cooking023_6_E01_wrong_execution_4014446b/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_sfu_cooking023_6_E01_wrong_execution_4014446b/error_context.mp4",
"correct_clip": "generation_error/sa... | {
"sample_id": "v2_ab_letterbox_arm_B_ee4d_sfu_cooking023_6_E01_wrong_execution_4014446b",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 1,
"error_end_s": 5,
"visible_error": "将蛋液倒入水槽而非平底锅。",
"difference_from_correct": "正确动作是倒入平底锅，错误动作是倒入水槽。",
"physics_check": "通过",
"reason": "视频2中将蛋液倒入水槽，属于明显的错... | {
"source_duration_s": 423.7,
"crop_start_s": 0,
"crop_end_s": 120,
"duration_s": 120,
"source_replacement_start_s": 48.056,
"source_replacement_end_s": 52.005,
"error_start_s": 48.056,
"error_end_s": 52.005,
"help_point_s": 49.056,
"duration_status": "within_target",
"continuity_policy": "120s_ev... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_letterbox_arm_B_ee4d_sfu_cooking023_6_E0... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_sfu_cooking023_6_E01_wrong_execution_4014446b/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_sfu_cooking023_6_E01_wrong_execu... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:00:08.054000+00:00"
} |
v2_ab_letterbox_arm_B_ee4d_uniandes_cooking_006_4_E01_substitution_02ca90f4 | substitution | object_or_predicate_swap | Place water on the stove | Place the milk pitcher on the stove. | Wait, you need to boil the water for the espresso first, not the milk. | The espresso cannot be brewed without boiling water, halting the latte-making process, and the milk might scald on the direct heat. | wrong_object | EgoExo4D | ee4d_uniandes_cooking_006_4 | Complete the Making Coffee latte correctly | ego | false | 3.5 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 2,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | promoted_after_review | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/uniandes_cooking_006_4/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 92.517,
"want_s": 2.167,
"aligned_source_interval": [
0,
2.167
]
} | {
"correct_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_uniandes_cooking_006_4_E01_substitution_02ca90f4/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_letterbox_arm_B_ee4d_uniandes_cooking_006_4_E01_substitution_02ca90f4/error_context.mp4",
"correct_clip": "generation_er... | {
"sample_id": "v2_ab_letterbox_arm_B_ee4d_uniandes_cooking_006_4_E01_substitution_02ca90f4",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 0,
"error_end_s": 3,
"visible_error": "视频2中将装有牛奶的拉花杯直接放在燃气灶上加热，而不是加热水。",
"difference_from_correct": "视频1中加热的是水，而视频2中错误地将牛奶杯放在火上加热。",
"physics_check": "通过",
... | {
"source_duration_s": 263.27,
"crop_start_s": 32.517,
"crop_end_s": 152.517,
"duration_s": 120,
"source_replacement_start_s": 92.517,
"source_replacement_end_s": 94.684,
"error_start_s": 60,
"error_end_s": 62.167,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_letterbox_arm_B_ee4d_uniandes_cooking_00... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_uniandes_cooking_006_4_E01_substitution_02ca90f4/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_letterbox_arm_B_ee4d_uniandes_cooking_006_4_E01_su... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:00:21.818604+00:00"
} |
v2_ab_prompt_arm_A_ee4d_uniandes_cooking_005_6_E01_substitution_77041708 | substitution | object_or_predicate_swap | Get a cup or mug | Get a small espresso cup. | You'll need a bigger mug for a latte, that espresso cup is too small. | The vessel's capacity is too small for the intended drink, preventing the addition of the required amount of steamed milk. | wrong_object | EgoExo4D | ee4d_uniandes_cooking_005_6 | Complete the Making Coffee latte correctly | ego | false | 3.167 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 3,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/uniandes_cooking_005_6/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 85.939,
"want_s": 4.817,
"aligned_source_interval": [
2.769775,
4.817
]
} | {
"correct_context": "generation_error/samples/v2_ab_prompt_arm_A_ee4d_uniandes_cooking_005_6_E01_substitution_77041708/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_prompt_arm_A_ee4d_uniandes_cooking_005_6_E01_substitution_77041708/error_context.mp4",
"correct_clip": "generation_error/sa... | {
"sample_id": "v2_ab_prompt_arm_A_ee4d_uniandes_cooking_005_6_E01_substitution_77041708",
"label": "有问题",
"confidence": 0.9,
"error_start_s": 0,
"error_end_s": 1.5,
"visible_error": "视频2中，操作者拿取并使用了一个小的浓缩咖啡杯，而不是像视频1中那样拿取一个适合做拿铁的大马克杯。",
"difference_from_correct": "视频1中操作者拿取的是一个白色的大马克杯；而视频2中操作者拿取并使用的是一个非常小的... | {
"source_duration_s": 321.17,
"crop_start_s": 25.939,
"crop_end_s": 145.939,
"duration_s": 120,
"source_replacement_start_s": 85.939,
"source_replacement_end_s": 90.756,
"error_start_s": 60,
"error_end_s": 64.817,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_prompt_arm_A_ee4d_uniandes_cooking_005_6... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_prompt_arm_A_ee4d_uniandes_cooking_005_6_E01_substitution_77041708/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_prompt_arm_A_ee4d_uniandes_cooking_005_6_E01_substitu... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:00:39.470783+00:00"
} |
v2_ab_prompt_arm_B_ee4d_iiith_cooking_43_3_E03_substitution_e7a4778b | substitution | object_or_predicate_swap | Wipe hands | Wipe hands with the wet dish sponge. | Don't use the dish sponge on your hands, grab the towel! | Soap or bacteria from the sponge contaminates the hands, which then handle the raw salad ingredients, making the salad inedible or unsafe. | wrong_state | EgoExo4D | ee4d_iiith_cooking_43_3 | Complete the Making Cucumber & Tomato Salad correctly | ego | false | 3.25 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/iiith_cooking_43_3/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 80.407,
"want_s": 2.178,
"aligned_source_interval": [
0,
2.01465
]
} | {
"correct_context": "generation_error/samples/v2_ab_prompt_arm_B_ee4d_iiith_cooking_43_3_E03_substitution_e7a4778b/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_prompt_arm_B_ee4d_iiith_cooking_43_3_E03_substitution_e7a4778b/error_context.mp4",
"correct_clip": "generation_error/samples/v2... | {
"sample_id": "v2_ab_prompt_arm_B_ee4d_iiith_cooking_43_3_E03_substitution_e7a4778b",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 0,
"error_end_s": 2,
"visible_error": "视频2中，人使用黄绿色的洗碗海绵来擦手，而不是使用旁边的格子抹布。",
"difference_from_correct": "视频1中，人使用格子抹布擦手；而视频2中，人错误地使用洗碗海绵擦手。",
"physics_check": "通过",
... | {
"source_duration_s": 120.67,
"crop_start_s": 0,
"crop_end_s": 120.67,
"duration_s": 120.67,
"source_replacement_start_s": 80.407,
"source_replacement_end_s": 82.585,
"error_start_s": 80.407,
"error_end_s": 82.585,
"help_point_s": 80.407,
"duration_status": "within_target",
"continuity_policy": "... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_prompt_arm_B_ee4d_iiith_cooking_43_3_E03... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_prompt_arm_B_ee4d_iiith_cooking_43_3_E03_substitution_e7a4778b/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_prompt_arm_B_ee4d_iiith_cooking_43_3_E03_substitution_e7a... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:00:44.700578+00:00"
} |
v2_ab_prompt_arm_B_ee4d_upenn_0714_Cooking_1_4_E01_wrong_execution_f2337413 | wrong_execution | execution_deviation | Throw out trash or waste | Sweep the unused ginger root into the trash bin. | Watch out, you're throwing away the good ginger! | The usable ginger is lost in the trash, meaning it cannot be used for the rest of the recipe or future meals. | wrong_object | EgoExo4D | ee4d_upenn_0714_Cooking_1_4 | Complete the Making Sesame-Ginger Asian Salad correctly | ego | false | 4.333 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 3,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/upenn_0714_Cooking_1_4/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 309.966,
"want_s": 4.38,
"aligned_source_interval": [
1.6425,
4.38
]
} | {
"correct_context": "generation_error/samples/v2_ab_prompt_arm_B_ee4d_upenn_0714_Cooking_1_4_E01_wrong_execution_f2337413/correct_context.mp4",
"error_context": "generation_error/samples/v2_ab_prompt_arm_B_ee4d_upenn_0714_Cooking_1_4_E01_wrong_execution_f2337413/error_context.mp4",
"correct_clip": "generation_er... | {
"sample_id": "v2_ab_prompt_arm_B_ee4d_upenn_0714_Cooking_1_4_E01_wrong_execution_f2337413",
"label": "有问题",
"confidence": 0.7,
"error_start_s": 1,
"error_end_s": 3,
"visible_error": "操作者将装有完好生姜的粉色塑料袋直接扔进垃圾桶。",
"difference_from_correct": "正确视频中仅丢弃了厨余垃圾，而错误视频中丢弃了完好且可用的生姜。",
"physics_check": "通过",
"rea... | {
"source_duration_s": 653.77,
"crop_start_s": 249.966,
"crop_end_s": 369.966,
"duration_s": 120,
"source_replacement_start_s": 309.966,
"source_replacement_end_s": 314.346,
"error_start_s": 60,
"error_end_s": 64.38,
"help_point_s": 61,
"duration_status": "within_target",
"continuity_policy": "120... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_ab_prompt_arm_B_ee4d_upenn_0714_Cooking_1_4... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_prompt_arm_B_ee4d_upenn_0714_Cooking_1_4_E01_wrong_execution_f2337413/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_ab_prompt_arm_B_ee4d_upenn_0714_Cooking_1_4_E01_wrong... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:00:52.894287+00:00"
} |
v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E01_substitution_57e08103 | substitution | object_or_predicate_swap | Wash the metal bowl with water | Wipe the metal bowl with a dry paper towel. | You need to actually wash that bowl with water, not just wipe it. | Cross-contamination or ruined texture in the next step because the bowl wasn't properly cleaned. | wrong_state | autoann | auto_eel_bee93bfc | Complete the laboratory or kitchen task correctly | unspecified | false | 5.667 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee93bfc-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 121.55,
"want_s": 6.75,
"aligned_source_interval": [
0,
6.24375
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E01_substitution_57e08103/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E01_substitution_57e08103/error_context.mp4",
"correct_clip": "generation_erro... | {
"sample_id": "v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E01_substitution_57e08103",
"label": "有问题",
"confidence": 1,
"error_start_s": 0,
"error_end_s": 5,
"visible_error": "视频2中，操作人员使用干纸巾擦拭金属碗，而不是像视频1中那样用清水冲洗金属碗。",
"difference_from_correct": "视频1中，操作人员在水龙头下用清水冲洗并清洗金属碗；而视频2中，操作人员仅用干纸巾擦拭金属碗，没有用水清洗。... | {
"source_duration_s": 665.6,
"crop_start_s": 61.55,
"crop_end_s": 181.55,
"duration_s": 120,
"source_replacement_start_s": 121.55,
"source_replacement_end_s": 128.3,
"error_start_s": 60,
"error_end_s": 66.75,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee93b... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E01_substitution_57e08103/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E01_subs... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:11:33.703112+00:00"
} |
v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E03_wrong_execution_4f016a34 | wrong_execution | execution_deviation | Pour water from the bowl into the wok | Pour oil from the bowl into the wok. | Wait, that's the oil, you need to pour the water in! | Adding oil instead of water alters the cooking process, which will ruin the intended texture, flavor, and outcome of the recipe. | wrong_object | autoann | auto_eel_bee93bfc | Complete the laboratory or kitchen task correctly | unspecified | false | 3.958 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 3,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee93bfc-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 345.7,
"want_s": 2.5,
"aligned_source_interval": [
0,
2.5
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E03_wrong_execution_4f016a34/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E03_wrong_execution_4f016a34/error_context.mp4",
"correct_clip": "generatio... | {
"sample_id": "v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E03_wrong_execution_4f016a34",
"label": "有问题",
"confidence": 0.75,
"error_start_s": 0,
"error_end_s": 3,
"visible_error": "视频2中向锅内倒入的是黄色液体（疑似蛋液或油），而非清水。",
"difference_from_correct": "视频1中准备倒入的是清水，而视频2中错误地倒入黄色液体，不符合正确步骤。",
"physics_check": ... | {
"source_duration_s": 665.6,
"crop_start_s": 285.7,
"crop_end_s": 405.7,
"duration_s": 120,
"source_replacement_start_s": 345.7,
"source_replacement_end_s": 348.2,
"error_start_s": 60,
"error_end_s": 62.5,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event_ce... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee93b... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E03_wrong_execution_4f016a34/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee93bfc_E03_w... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:13:07.419864+00:00"
} |
v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_substitution_24218dc3 | substitution | object_or_predicate_swap | Cut the peeled garlic into small pieces on the cutting board | Cut the unpeeled garlic clove into small pieces on the cutting board. | Wait, you need to peel that clove before you chop it! | Inedible garlic skin is incorporated into the prepped ingredients, which will ruin the texture and mouthfeel of the final dish. | wrong_object | autoann | auto_eel_bee94084 | Complete the laboratory or kitchen task correctly | unspecified | false | 9.833 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee94084-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 573.1,
"want_s": 14.5,
"aligned_source_interval": [
0,
14.5
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_substitution_24218dc3/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_substitution_24218dc3/error_context.mp4",
"correct_clip": "generation_erro... | {
"sample_id": "v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_substitution_24218dc3",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 1,
"error_end_s": 8,
"visible_error": "操作者直接切未剥皮的整头大蒜，导致蒜皮混入其中。",
"difference_from_correct": "视频1切的是已剥皮的干净蒜瓣，视频2切的是带皮的整蒜。",
"physics_check": "通过",
"reason": ... | {
"source_duration_s": 1043.36,
"crop_start_s": 513.1,
"crop_end_s": 633.1,
"duration_s": 120,
"source_replacement_start_s": 573.1,
"source_replacement_end_s": 587.6,
"error_start_s": 60,
"error_end_s": 74.5,
"help_point_s": 61,
"duration_status": "within_target",
"continuity_policy": "120s_event_... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee940... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_substitution_24218dc3/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_subs... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:13:14.889065+00:00"
} |
v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_wrong_execution_6a9c60c8 | wrong_execution | execution_deviation | Cut the peeled garlic into small pieces on the cutting board | Cut the ginger into small pieces on the countertop. | That's the ginger, not the garlic, and you shouldn't cut directly on the counter! | The dish will have the wrong flavor profile because ginger is added instead of garlic, and the countertop may be damaged or contaminated. | wrong_object | autoann | auto_eel_bee94084 | Complete the laboratory or kitchen task correctly | unspecified | false | 7.333 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 2,
"action_timing": 4,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | promoted_after_review | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee94084-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 573.1,
"want_s": 14.5,
"aligned_source_interval": [
0,
13.4125
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_wrong_execution_6a9c60c8/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_wrong_execution_6a9c60c8/error_context.mp4",
"correct_clip": "generatio... | {
"sample_id": "v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_wrong_execution_6a9c60c8",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 0,
"error_end_s": 6,
"visible_error": "操作者在白色台面上直接切生姜，而不是在砧板上切大蒜。",
"difference_from_correct": "正确步骤是在砧板上切碎大蒜，错误步骤是直接在台面上切生姜。",
"physics_check": "通过",
"re... | {
"source_duration_s": 1043.36,
"crop_start_s": 513.1,
"crop_end_s": 633.1,
"duration_s": 120,
"source_replacement_start_s": 573.1,
"source_replacement_end_s": 587.6,
"error_start_s": 60,
"error_end_s": 74.5,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event_... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee940... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_wrong_execution_6a9c60c8/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94084_E02_w... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:13:26.912896+00:00"
} |
v2_dataset_v2_batch3_autoann_A_auto_eel_bee94138_E02_wrong_execution_096cfcca | wrong_execution | execution_deviation | Hold the leek and cut off its root | Hold the leek and cut off its green top. | Wait, you need to cut off the root end first! | If the root is not removed, dirt and the tough root base will end up in the chopped leek. | wrong_state | autoann | auto_eel_bee94138 | Complete the laboratory or kitchen task correctly | unspecified | false | 9 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 3,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee94138-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 168.55,
"want_s": 5.75,
"aligned_source_interval": [
0,
5.75
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94138_E02_wrong_execution_096cfcca/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94138_E02_wrong_execution_096cfcca/error_context.mp4",
"correct_clip": "generatio... | {
"sample_id": "v2_dataset_v2_batch3_autoann_A_auto_eel_bee94138_E02_wrong_execution_096cfcca",
"label": "有问题",
"confidence": 0.75,
"error_start_s": 2,
"error_end_s": 6,
"visible_error": "操作者切断了大葱的绿色叶梢部分，而非切除根部。",
"difference_from_correct": "正确动作应切除大葱根部，视频2中却切掉了绿色的叶子顶部。",
"physics_check": "通过",
"reaso... | {
"source_duration_s": 698.56,
"crop_start_s": 108.55,
"crop_end_s": 228.55,
"duration_s": 120,
"source_replacement_start_s": 168.55,
"source_replacement_end_s": 174.3,
"error_start_s": 60,
"error_end_s": 65.75,
"help_point_s": 62,
"duration_status": "within_target",
"continuity_policy": "120s_eve... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee941... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94138_E02_wrong_execution_096cfcca/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94138_E02_w... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:13:44.287007+00:00"
} |
v2_dataset_v2_batch3_autoann_A_auto_eel_bee9434a_E03_wrong_execution_98b28c65 | wrong_execution | execution_deviation | Pour chicken essence seasoning into the pan | Pour salt into the pan. | Wait, you're adding salt, not the chicken essence! | Adding the wrong seasoning ruins the intended taste and balance of the recipe. | wrong_object | autoann | auto_eel_bee9434a | Complete the laboratory or kitchen task correctly | unspecified | false | 6.458 | {
"error_semantics": 3,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 2,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | promoted_after_review | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee9434a-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 570.5,
"want_s": 4.75,
"aligned_source_interval": [
0.35624999999999996,
4.39375
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9434a_E03_wrong_execution_98b28c65/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9434a_E03_wrong_execution_98b28c65/error_context.mp4",
"correct_clip": "generatio... | {
"sample_id": "v2_dataset_v2_batch3_autoann_A_auto_eel_bee9434a_E03_wrong_execution_98b28c65",
"label": "有问题",
"confidence": 0.7,
"error_start_s": 0,
"error_end_s": 5,
"visible_error": "视频2中向锅中倒入的是大量食盐，而非鸡精调味品。",
"difference_from_correct": "视频1倒入黄色袋装鸡精，视频2倒入白色瓶装食盐。",
"physics_check": "通过",
"reason": ... | {
"source_duration_s": 647.48,
"crop_start_s": 510.5,
"crop_end_s": 630.5,
"duration_s": 120,
"source_replacement_start_s": 570.5,
"source_replacement_end_s": 575.25,
"error_start_s": 60,
"error_end_s": 64.75,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee943... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9434a_E03_wrong_execution_98b28c65/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9434a_E03_w... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:20:37.892673+00:00"
} |
v2_dataset_v2_batch3_autoann_A_auto_eel_bee9444e_E02_wrong_execution_987aa322 | wrong_execution | execution_deviation | Pour some vinegar from the bottle into the wok | Pour some vinegar from the bottle into the small prep bowl next to the wok. | Wait, pour the vinegar directly into the wok, not into that bowl! | The recipe fails because a key flavoring ingredient is missing from the main dish during the cooking process. | wrong_destination | autoann | auto_eel_bee9444e | Complete the laboratory or kitchen task correctly | unspecified | false | 3.167 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee9444e-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 757.75,
"want_s": 2.25,
"aligned_source_interval": [
0.25,
2.25
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9444e_E02_wrong_execution_987aa322/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9444e_E02_wrong_execution_987aa322/error_context.mp4",
"correct_clip": "generatio... | {
"sample_id": "v2_dataset_v2_batch3_autoann_A_auto_eel_bee9444e_E02_wrong_execution_987aa322",
"label": "有问题",
"confidence": 0.7,
"error_start_s": 0,
"error_end_s": 2,
"visible_error": "将调味汁倒入炒锅旁的金属小碗中，而非直接倒入炒锅内。",
"difference_from_correct": "正确动作是将调料直接倒入炒锅，错误动作则是倒入旁边的备用小碗中。",
"physics_check": "通过",
... | {
"source_duration_s": 876.92,
"crop_start_s": 697.75,
"crop_end_s": 817.75,
"duration_s": 120,
"source_replacement_start_s": 757.75,
"source_replacement_end_s": 760,
"error_start_s": 60,
"error_end_s": 62.25,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee944... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9444e_E02_wrong_execution_987aa322/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9444e_E02_w... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:21:00.200571+00:00"
} |
v2_dataset_v2_batch3_autoann_A_auto_eel_bee9470a_E01_substitution_fe2a08d7 | substitution | object_or_predicate_swap | Use a piece of fat to wipe the wok | Use a piece of lean meat to wipe the wok. | That's the lean meat, you need the fat to oil the wok! | Without the rendered fat, the wok lacks a non-stick coating, causing subsequent ingredients to stick and burn. | wrong_object | autoann | auto_eel_bee9470a | Complete the laboratory or kitchen task correctly | unspecified | false | 4.792 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee9470a-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 211.15,
"want_s": 3,
"aligned_source_interval": [
0,
3
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9470a_E01_substitution_fe2a08d7/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9470a_E01_substitution_fe2a08d7/error_context.mp4",
"correct_clip": "generation_erro... | {
"sample_id": "v2_dataset_v2_batch3_autoann_A_auto_eel_bee9470a_E01_substitution_fe2a08d7",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 0,
"error_end_s": 4,
"visible_error": "在视频2中，操作者使用了一大块红色的瘦肉（牛排）来擦拭锅底，而不是像视频1中那样使用一块肥肉。",
"difference_from_correct": "视频1中使用的是一小块白色的肥肉来润锅，而视频2中错误地使用了一整块红色的瘦肉。",
... | {
"source_duration_s": 965.84,
"crop_start_s": 151.15,
"crop_end_s": 271.15,
"duration_s": 120,
"source_replacement_start_s": 211.15,
"source_replacement_end_s": 214.15,
"error_start_s": 60,
"error_end_s": 63,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee947... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9470a_E01_substitution_fe2a08d7/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee9470a_E01_subs... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:21:08.796780+00:00"
} |
v2_dataset_v2_batch3_autoann_A_auto_eel_bee94ac0_E01_substitution_2d6129ce | substitution | object_or_predicate_swap | Wash the peeled garlic cloves under the faucet | Wash the peeled garlic cloves with dish soap under the faucet. | Don't use dish soap on the food! | The ingredient is ruined by the soap, making the resulting dish taste like detergent and rendering it unsafe to eat. | wrong_state | autoann | auto_eel_bee94ac0 | Complete the laboratory or kitchen task correctly | unspecified | false | 3.167 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee94ac0-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 180.65,
"want_s": 2,
"aligned_source_interval": [
0,
2
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94ac0_E01_substitution_2d6129ce/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94ac0_E01_substitution_2d6129ce/error_context.mp4",
"correct_clip": "generation_erro... | {
"sample_id": "v2_dataset_v2_batch3_autoann_A_auto_eel_bee94ac0_E01_substitution_2d6129ce",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 0,
"error_end_s": 2,
"visible_error": "在清洗剥好的大蒜时，使用了洗洁精，导致双手和大蒜上布满了白色泡沫。",
"difference_from_correct": "正确视频中仅用清水冲洗大蒜，而错误视频中使用了洗洁精，产生了大量泡沫，这会污染食物。",
"physics_c... | {
"source_duration_s": 1005.76,
"crop_start_s": 120.65,
"crop_end_s": 240.65,
"duration_s": 120,
"source_replacement_start_s": 180.65,
"source_replacement_end_s": 182.65,
"error_start_s": 60,
"error_end_s": 62,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_even... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94a... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94ac0_E01_substitution_2d6129ce/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_autoann_A_auto_eel_bee94ac0_E01_subs... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:21:16.865003+00:00"
} |
v2_dataset_v2_batch3_densestep_A_ds_EXZIpIsahzU_E01_wrong_execution_1751fde1 | wrong_execution | execution_deviation | Cut out green leaves from the green felt. | Cut out leaves from the red felt. | Wait, you are supposed to use the green felt for the leaves, not the red one! | The final assembled craft will have incorrectly colored parts, failing the design requirements. | wrong_object | DenseStep2M/HowTo100M | ds_EXZIpIsahzU | Complete the instructional task correctly | unspecified | false | 3.167 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1280x720",
"generated": "1280x720",
"exact_size_match": true,
"aspect_preserved": true,
"area_ratio": 1
} | passed_lean_gates | <source>/source_videos/densestep/EXZIpIsahzU.mp4 | {
"step_index": 523.26,
"want_s": 2,
"aligned_source_interval": [
0,
2
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_densestep_A_ds_EXZIpIsahzU_E01_wrong_execution_1751fde1/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_densestep_A_ds_EXZIpIsahzU_E01_wrong_execution_1751fde1/error_context.mp4",
"correct_clip": "generation_... | {
"sample_id": "v2_dataset_v2_batch3_densestep_A_ds_EXZIpIsahzU_E01_wrong_execution_1751fde1",
"label": "有问题",
"confidence": 0.75,
"error_start_s": 0,
"error_end_s": 2,
"visible_error": "错误地使用了红色毛毡剪裁叶子。",
"difference_from_correct": "正确视频使用绿色毛毡，而错误视频使用了红色毛毡。",
"physics_check": "通过",
"reason": "视频2中使用了红... | {
"source_duration_s": 663.42,
"crop_start_s": 463.26,
"crop_end_s": 583.26,
"duration_s": 120,
"source_replacement_start_s": 523.26,
"source_replacement_end_s": 525.26,
"error_start_s": 60,
"error_end_s": 62,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_densestep_A_ds_EXZIpIsahz... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_densestep_A_ds_EXZIpIsahzU_E01_wrong_execution_1751fde1/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_densestep_A_ds_EXZIpIsahzU_E01_wro... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:21:25.683338+00:00"
} |
v2_dataset_v2_batch3_densestep_A_ds_Ty9p_sDQLf4_E03_substitution_fa033571 | substitution | object_or_predicate_swap | Hot glue Velcro strips to the plastic rectangle. | Apply glue from a glue stick to the Velcro strips and press them onto the plastic rectangle. | A glue stick won't hold on plastic, you need to use the hot glue gun. | The weak bond from the glue stick cannot adhere properly to plastic or fabric, causing the Velcro strip to detach completely the first time it is used. | wrong_state | DenseStep2M/HowTo100M | ds_Ty9p-sDQLf4 | Complete the instructional task correctly | unspecified | false | 4.667 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 3,
"task_impact": 3,
"source_fidelity": 4,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "1280x720",
"generated": "1280x720",
"exact_size_match": true,
"aspect_preserved": true,
"area_ratio": 1
} | passed_lean_gates | <source>/source_videos/densestep/Ty9p-sDQLf4.mp4 | {
"step_index": 272.13,
"want_s": 3.14,
"aligned_source_interval": [
0,
2.9045
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_densestep_A_ds_Ty9p_sDQLf4_E03_substitution_fa033571/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_densestep_A_ds_Ty9p_sDQLf4_E03_substitution_fa033571/error_context.mp4",
"correct_clip": "generation_error/... | {
"sample_id": "v2_dataset_v2_batch3_densestep_A_ds_Ty9p_sDQLf4_E03_substitution_fa033571",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 0,
"error_end_s": 4,
"visible_error": "在视频2中，使用的是白色液体胶水（或普通胶棒）涂抹在黑色魔术贴背面，而不是使用热熔胶枪。",
"difference_from_correct": "视频1中，操作者使用热熔胶枪将热熔胶涂在塑料片上，然后粘上魔术贴；而视频2中，操作者将白色普通... | {
"source_duration_s": 747.03,
"crop_start_s": 212.13,
"crop_end_s": 332.13,
"duration_s": 120,
"source_replacement_start_s": 272.13,
"source_replacement_end_s": 275.27,
"error_start_s": 60,
"error_end_s": 63.14,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_ev... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_densestep_A_ds_Ty9p_sDQLf... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_densestep_A_ds_Ty9p_sDQLf4_E03_substitution_fa033571/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_densestep_A_ds_Ty9p_sDQLf4_E03_substi... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:21:59.172169+00:00"
} |
v2_dataset_v2_batch3_ego16_A_eel_bee93bfc_E01_substitution_02706d06 | substitution | object_or_predicate_swap | Hold the pot and use a spoon to quickly evaporate the water | Hold the pot and cover it with a lid. | Take the lid off so the water can actually evaporate! | The dish will remain watery and fail to reduce to the desired consistency. | wrong_state | EgoExoLearn | eel_bee93bfc | Complete the kitchen procedure correctly | ego | false | 4.125 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee93bfc-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 239,
"want_s": 2.6,
"aligned_source_interval": [
0,
2.6
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93bfc_E01_substitution_02706d06/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93bfc_E01_substitution_02706d06/error_context.mp4",
"correct_clip": "generation_error/samples/v2_d... | {
"sample_id": "v2_dataset_v2_batch3_ego16_A_eel_bee93bfc_E01_substitution_02706d06",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 0,
"error_end_s": 3,
"visible_error": "在视频2中，操作人员用盖子盖住了锅，而不是像视频1中那样用勺子搅拌以快速蒸发水分。",
"difference_from_correct": "视频1中操作人员手持锅并用勺子搅拌以促进水分蒸发；而视频2中操作人员却用盖子把锅盖上了，这会导致水分无法蒸发。"... | {
"source_duration_s": 665.6,
"crop_start_s": 179,
"crop_end_s": 299,
"duration_s": 120,
"source_replacement_start_s": 239,
"source_replacement_end_s": 241.6,
"error_start_s": 60,
"error_end_s": 62.6,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event_centered... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93bfc_E01_... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93bfc_E01_substitution_02706d06/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93bfc_E01_substitution_02706... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:22:23.143448+00:00"
} |
v2_dataset_v2_batch3_ego16_A_eel_bee93f44_E01_substitution_39d61ea4 | substitution | object_or_predicate_swap | Hold the kitchen knife to chop the garlic into small pieces | Hold the kitchen knife to chop the onion into small pieces. | Wait, you need to chop the garlic right now, not the onion. | The garlic remains unchopped, and adding onion instead of garlic at this stage will alter the recipe's flavor profile and cooking timing. | wrong_object | EgoExoLearn | eel_bee93f44 | Complete the kitchen procedure correctly | ego | false | 8.292 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee93f44-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 145,
"want_s": 11.4,
"aligned_source_interval": [
0,
11.4
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93f44_E01_substitution_39d61ea4/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93f44_E01_substitution_39d61ea4/error_context.mp4",
"correct_clip": "generation_error/samples/v2_d... | {
"sample_id": "v2_dataset_v2_batch3_ego16_A_eel_bee93f44_E01_substitution_39d61ea4",
"label": "有问题",
"confidence": 1,
"error_start_s": 0,
"error_end_s": 7,
"visible_error": "视频中切的是洋葱，而不是大蒜。",
"difference_from_correct": "正确视频中正在将大蒜切碎，而错误视频中则是在切洋葱。",
"physics_check": "通过",
"reason": "错误视频中切洋葱代替了切大蒜，这与正... | {
"source_duration_s": 610.04,
"crop_start_s": 85,
"crop_end_s": 205,
"duration_s": 120,
"source_replacement_start_s": 145,
"source_replacement_end_s": 156.4,
"error_start_s": 60,
"error_end_s": 71.4,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event_centered... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93f44_E01_... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93f44_E01_substitution_39d61ea4/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee93f44_E01_substitution_39d61... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:22:50.074186+00:00"
} |
v2_dataset_v2_batch3_ego16_A_eel_bee94200_E01_wrong_execution_9de37d8a | wrong_execution | execution_deviation | Hold garlic, peel off skin, throw skin into the garbage bag | Hold garlic, peel off skin, throw skin into the ingredient bowl. | Wait, you just threw the peels into the bowl with the food! | Contaminates the prepared ingredients with waste material, requiring rework to separate them. | wrong_destination | EgoExoLearn | eel_bee94200 | Complete the kitchen procedure correctly | ego | false | 9 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 3,
"action_timing": 4,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee94200-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 111.7,
"want_s": 14.5,
"aligned_source_interval": [
0,
14.5
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94200_E01_wrong_execution_9de37d8a/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94200_E01_wrong_execution_9de37d8a/error_context.mp4",
"correct_clip": "generation_error/sample... | {
"sample_id": "v2_dataset_v2_batch3_ego16_A_eel_bee94200_E01_wrong_execution_9de37d8a",
"label": "有问题",
"confidence": 0.7,
"error_start_s": 5,
"error_end_s": 7,
"visible_error": "剥蒜皮时，将废弃的蒜皮直接扔进了盛有切好葱花的食材盘中。",
"difference_from_correct": "正确步骤应将蒜皮扔进垃圾袋，而视频2将其扔进食材盘，污染了葱花。",
"physics_check": "通过",
"reas... | {
"source_duration_s": 730.4,
"crop_start_s": 51.7,
"crop_end_s": 171.7,
"duration_s": 120,
"source_replacement_start_s": 111.7,
"source_replacement_end_s": 126.2,
"error_start_s": 60,
"error_end_s": 74.5,
"help_point_s": 65,
"duration_status": "within_target",
"continuity_policy": "120s_event_cen... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94200_E01_... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94200_E01_wrong_execution_9de37d8a/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94200_E01_wrong_execution... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:23:23.460389+00:00"
} |
v2_dataset_v2_batch3_ego16_A_eel_bee94944_E01_wrong_execution_f9e29d78 | wrong_execution | execution_deviation | Hold the bowl and use the chopsticks to thoroughly stir the eggs until beaten | Hold the bowl and use the chopsticks to stir along the inner rim of the bowl, leaving the egg yolks unbroken. | Make sure to break the yolks and mix it all together, not just stir around the edges. | Failing to beat the eggs prevents them from forming a uniform structure when cooked, ruining the intended texture and appearance of the dish. | wrong_state | EgoExoLearn | eel_bee94944 | Complete the kitchen procedure correctly | ego | false | 9.708 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee94944-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 239.6,
"want_s": 7.4,
"aligned_source_interval": [
1.295,
7.4
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94944_E01_wrong_execution_f9e29d78/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94944_E01_wrong_execution_f9e29d78/error_context.mp4",
"correct_clip": "generation_error/sample... | {
"sample_id": "v2_dataset_v2_batch3_ego16_A_eel_bee94944_E01_wrong_execution_f9e29d78",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 0,
"error_end_s": 6,
"visible_error": "筷子仅沿碗壁搅拌，未戳破或打散蛋黄。",
"difference_from_correct": "正确动作中蛋液已完全打散混合，而此版本中蛋黄保持完整未破。",
"physics_check": "通过",
"reason": "视频2中未将蛋... | {
"source_duration_s": 653.48,
"crop_start_s": 179.6,
"crop_end_s": 299.6,
"duration_s": 120,
"source_replacement_start_s": 239.6,
"source_replacement_end_s": 247,
"error_start_s": 60,
"error_end_s": 67.4,
"help_point_s": 60,
"duration_status": "within_target",
"continuity_policy": "120s_event_cen... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94944_E01_... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94944_E01_wrong_execution_f9e29d78/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94944_E01_wrong_execution... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:23:58.671845+00:00"
} |
v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E01_wrong_execution_2d602cb1 | wrong_execution | execution_deviation | Press on the green pepper and cut it into large pieces with a knife | Press on the red pepper and cut it into large pieces with a meat cleaver. | Wait, you need the green pepper for this, and a regular knife is much easier to use than that heavy cleaver! | The wrong ingredient is added to the meal, failing to follow the recipe's specific flavor requirements. | wrong_object | EgoExoLearn | eel_bee94a02 | Complete the kitchen procedure correctly | ego | false | 9 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee94a02-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 4.4,
"want_s": 11.2,
"aligned_source_interval": [
0,
11.2
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E01_wrong_execution_2d602cb1/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E01_wrong_execution_2d602cb1/error_context.mp4",
"correct_clip": "generation_error/sample... | {
"sample_id": "v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E01_wrong_execution_2d602cb1",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 0,
"error_end_s": 8,
"visible_error": "使用红椒代替绿椒，并用大菜刀进行切块。",
"difference_from_correct": "视频1切绿椒，视频2切红椒且工具不同。",
"physics_check": "通过",
"reason": "视频2中食材和刀具选择错误，不符... | {
"source_duration_s": 901.28,
"crop_start_s": 0,
"crop_end_s": 120,
"duration_s": 120,
"source_replacement_start_s": 4.4,
"source_replacement_end_s": 15.6,
"error_start_s": 4.4,
"error_end_s": 15.6,
"help_point_s": 4.4,
"duration_status": "within_target",
"continuity_policy": "120s_event_centered... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E01_... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E01_wrong_execution_2d602cb1/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E01_wrong_execution... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:24:08.584923+00:00"
} |
v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E02_wrong_execution_9cdd19d7 | wrong_execution | execution_deviation | Press the green pepper, hold a knife, cut the green pepper into large pieces, and place them on one side of the cutting board for later use | Press the red pepper, hold a knife, cut the red pepper into large pieces, and place them on one side of the cutting board for later use. | That's the red pepper, you need to cut the green one right now. | The green pepper is not ready when needed for the next cooking step, delaying the process or causing it to be omitted. | wrong_object | EgoExoLearn | eel_bee94a02 | Complete the kitchen procedure correctly | ego | false | 9.833 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee94a02-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 24,
"want_s": 11,
"aligned_source_interval": [
0,
11
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E02_wrong_execution_9cdd19d7/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E02_wrong_execution_9cdd19d7/error_context.mp4",
"correct_clip": "generation_error/sample... | {
"sample_id": "v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E02_wrong_execution_9cdd19d7",
"label": "有问题",
"confidence": 0.7,
"error_start_s": 0,
"error_end_s": 9,
"visible_error": "视频2中切的是红椒，而不是绿椒。",
"difference_from_correct": "正确步骤应该切绿椒，而视频2中错误地切了红椒。",
"physics_check": "通过",
"reason": "视频2中切红椒的动作清晰可见，... | {
"source_duration_s": 901.28,
"crop_start_s": 0,
"crop_end_s": 120,
"duration_s": 120,
"source_replacement_start_s": 24,
"source_replacement_end_s": 35,
"error_start_s": 24,
"error_end_s": 35,
"help_point_s": 24,
"duration_status": "within_target",
"continuity_policy": "120s_event_centered",
"e... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E02_... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E02_wrong_execution_9cdd19d7/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94a02_E02_wrong_execution... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:24:19.387162+00:00"
} |
v2_dataset_v2_batch3_ego16_A_eel_bee94b7e_E01_wrong_execution_ec8c2fca | wrong_execution | execution_deviation | Press the green pepper on the cutting board | Press the green pepper on the bare kitchen counter. | Move that pepper onto the cutting board before you press it! | Food contamination due to direct contact with an unsanitized countertop surface. | wrong_destination | EgoExoLearn | eel_bee94b7e | Complete the kitchen procedure correctly | ego | false | 7.458 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 3,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "1088x1080",
"generated": "724x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 0.444
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExoLearn/bee94b7e-ac78-11ee-819f-80615f12b59e.mp4 | {
"step_index": 79.9,
"want_s": 8.3,
"aligned_source_interval": [
0,
8.3
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94b7e_E01_wrong_execution_ec8c2fca/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94b7e_E01_wrong_execution_ec8c2fca/error_context.mp4",
"correct_clip": "generation_error/sample... | {
"sample_id": "v2_dataset_v2_batch3_ego16_A_eel_bee94b7e_E01_wrong_execution_ec8c2fca",
"label": "有问题",
"confidence": 0.7,
"error_start_s": 1,
"error_end_s": 6,
"visible_error": "操作者将青椒放在裸露的厨房台面上进行切压，而非砧板上。",
"difference_from_correct": "视频1在砧板上切青椒，视频2在砧板旁的台面上切青椒。",
"physics_check": "通过",
"reason": "视... | {
"source_duration_s": 655.24,
"crop_start_s": 19.9,
"crop_end_s": 139.9,
"duration_s": 120,
"source_replacement_start_s": 79.9,
"source_replacement_end_s": 88.2,
"error_start_s": 60,
"error_end_s": 68.3,
"help_point_s": 61,
"duration_status": "within_target",
"continuity_policy": "120s_event_cent... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94b7e_E01_... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94b7e_E01_wrong_execution_ec8c2fca/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_ego16_A_eel_bee94b7e_E01_wrong_execution... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:24:26.027783+00:00"
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_cmu_bike05_2_E01_substitution_0204ef5a | substitution | object_or_predicate_swap | Loosen both axle nuts using a wrench | Loosen both axle nuts using a pair of pliers. | Stop, you're going to strip the nut with those pliers, use a proper wrench. | Stripping the axle nut makes it impossible to remove with standard tools, preventing the wheel from being taken off. | wrong_state | EgoExo4D | ee4d_cmu_bike05_2 | Complete the Remove a Wheel correctly | ego | false | 10 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 3,
"action_timing": 4,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/cmu_bike05_2/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 5.273,
"want_s": 13.47,
"aligned_source_interval": [
0,
13.47
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_cmu_bike05_2_E01_substitution_0204ef5a/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_cmu_bike05_2_E01_substitution_0204ef5a/error_context.mp4",
"correct_clip": "generation_er... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_cmu_bike05_2_E01_substitution_0204ef5a",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 2,
"error_end_s": 9,
"visible_error": "视频2中，操作者使用钳子（pliers）来拧松车轴螺母，而不是使用合适的开口扳手或套筒扳手。",
"difference_from_correct": "视频1中，操作者使用合适的扳手安全地拧松车轴螺母；而视频2中，操作者错误地使用钳子去拧... | {
"source_duration_s": 33.2,
"crop_start_s": 0,
"crop_end_s": 33.2,
"duration_s": 33.2,
"source_replacement_start_s": 5.273,
"source_replacement_end_s": 18.743,
"error_start_s": 5.273,
"error_end_s": 18.743,
"help_point_s": 7.273,
"duration_status": "short_source",
"continuity_policy": "full_sourc... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_cmu_bike0... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_cmu_bike05_2_E01_substitution_0204ef5a/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_cmu_bike05_2_E01_su... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:24:39.638732+00:00"
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_02_3_E01_substitution_a7581566 | substitution | object_or_predicate_swap | Get a new inner tube | Pick up the old, punctured inner tube. | You grabbed the old flat tube, use the new one. | The punctured tube will not hold air when inflated, rendering the bike unrideable. | wrong_object | EgoExo4D | ee4d_fair_bike_02_3 | Complete the Fix a Flat Tire - Replace a Bike Tube correctly | ego | false | 5.667 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 3,
"motion_coherence": 4,
"visual_quality": 3
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/fair_bike_02_3/frame_aligned_videos/downscaled/448/aria02_214-1.mp4 | {
"step_index": 259.84,
"want_s": 10.911,
"aligned_source_interval": [
0,
10.911
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_02_3_E01_substitution_a7581566/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_02_3_E01_substitution_a7581566/error_context.mp4",
"correct_clip": "generatio... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_02_3_E01_substitution_a7581566",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 1,
"error_end_s": 5,
"visible_error": "操作人员从地上捡起了一个旧的、已经漏气的内胎，而不是像视频1那样从桌上拿取全新的、卷好的内胎。",
"difference_from_correct": "视频1中，操作人员从桌上拿取并展开全新的内胎；而视频2中，操作人员直接从地上捡起... | {
"source_duration_s": 495.43,
"crop_start_s": 199.84,
"crop_end_s": 319.84,
"duration_s": 120,
"source_replacement_start_s": 259.84,
"source_replacement_end_s": 270.751,
"error_start_s": 60,
"error_end_s": 70.911,
"help_point_s": 61,
"duration_status": "within_target",
"continuity_policy": "120s_... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_02_3_E01_substitution_a7581566/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_02_3_E0... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:24:49.393584+00:00"
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_18_E01_substitution_3a5bfb84 | substitution | object_or_predicate_swap | Get appropriate wrenches | Get a standard combination wrench. | That wrench won't work on tires, you need to grab the lug wrench. | The tool will not fit the lug nuts, making it impossible to remove the wheel and halting the task. | wrong_object | EgoExo4D | ee4d_fair_bike_06_18 | Complete the Remove a Wheel correctly | ego | false | 5.083 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/fair_bike_06_18/frame_aligned_videos/downscaled/448/aria06_214-1.mp4 | {
"step_index": 21.796,
"want_s": 5.123,
"aligned_source_interval": [
1.921125,
5.123
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_18_E01_substitution_3a5bfb84/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_18_E01_substitution_3a5bfb84/error_context.mp4",
"correct_clip": "generat... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_18_E01_substitution_3a5bfb84",
"label": "有问题",
"confidence": 0.9,
"error_start_s": 0,
"error_end_s": 4,
"visible_error": "视频2中展示并使用的是普通的梅花开口两用扳手，而不是视频1中使用的T型套筒扳手。",
"difference_from_correct": "视频1中拿取并使用的是T型套筒扳手，而视频2中拿取的是普通的梅花开口两用扳手。",
"ph... | {
"source_duration_s": 45.67,
"crop_start_s": 0,
"crop_end_s": 45.67,
"duration_s": 45.67,
"source_replacement_start_s": 21.796,
"source_replacement_end_s": 26.919,
"error_start_s": 21.796,
"error_end_s": 26.919,
"help_point_s": 21.796,
"duration_status": "short_source",
"continuity_policy": "full... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_18_E01_substitution_3a5bfb84/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_18_... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:25:01.537022+00:00"
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_19_E01_wrong_execution_aa1ee255 | wrong_execution | execution_deviation | Fit the tire to the wheel | Push the tire bead onto the wheel rim, leaving a section of the inner tube pinched outside the rim. | Stop, you need to tuck that piece of the tube inside before seating the tire! | The pinched tube will rupture upon inflation, failing the task of fixing the flat tire. | wrong_state | EgoExo4D | ee4d_fair_bike_06_19 | Complete the Fix a Flat Tire - Replace a Bike Tube correctly | ego | false | 6.5 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/fair_bike_06_19/frame_aligned_videos/downscaled/448/aria06_214-1.mp4 | {
"step_index": 72.867,
"want_s": 10.908,
"aligned_source_interval": [
2.9997000000000003,
10.908
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_19_E01_wrong_execution_aa1ee255/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_19_E01_wrong_execution_aa1ee255/error_context.mp4",
"correct_clip": "g... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_19_E01_wrong_execution_aa1ee255",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 1,
"error_end_s": 6,
"visible_error": "在安装外胎时，内胎的一部分被夹在外胎和轮毂边缘之间，露在外面。",
"difference_from_correct": "正确视频中，内胎被完全塞入外胎内部；而错误视频中，内胎有一截露在外面并被外胎边缘夹住。",
"phys... | {
"source_duration_s": 155.5,
"crop_start_s": 0,
"crop_end_s": 155.5,
"duration_s": 155.5,
"source_replacement_start_s": 72.867,
"source_replacement_end_s": 83.775,
"error_start_s": 72.867,
"error_end_s": 83.775,
"help_point_s": 73.867,
"duration_status": "within_target",
"continuity_policy": "ful... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_19_E01_wrong_execution_aa1ee255/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_06_... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:25:17.767827+00:00"
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_07_10_E01_substitution_0f20c1df | substitution | object_or_predicate_swap | Loosen both axle nuts using a wrench | Loosen both axle nuts using a pair of pliers. | Stop, you're going to strip the nut with those pliers, use a proper wrench. | Stripping the axle nut makes it impossible to remove with standard tools, preventing the wheel from being taken off. | wrong_state | EgoExo4D | ee4d_fair_bike_07_10 | Complete the Remove a Wheel correctly | ego | false | 10 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/fair_bike_07_10/frame_aligned_videos/downscaled/448/aria07_214-1.mp4 | {
"step_index": 19.058,
"want_s": 10.443,
"aligned_source_interval": [
0,
10.443
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_07_10_E01_substitution_0f20c1df/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_07_10_E01_substitution_0f20c1df/error_context.mp4",
"correct_clip": "generat... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_07_10_E01_substitution_0f20c1df",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 1,
"error_end_s": 9,
"visible_error": "操作员使用钳子（pliers）来松开车轴螺母，而不是使用合适的扳手（wrench）。",
"difference_from_correct": "在视频1中，操作员使用扳手正确地松开两侧的轴螺母；而在视频2中，操作员改用钳子来夹持并试... | {
"source_duration_s": 41.43,
"crop_start_s": 0,
"crop_end_s": 41.43,
"duration_s": 41.43,
"source_replacement_start_s": 19.058,
"source_replacement_end_s": 29.501,
"error_start_s": 19.058,
"error_end_s": 29.501,
"help_point_s": 20.058,
"duration_status": "short_source",
"continuity_policy": "full... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_07_10_E01_substitution_0f20c1df/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_fair_bike_07_10_... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:25:26.935666+00:00"
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_02_11_E01_substitution_01ae28a0 | substitution | object_or_predicate_swap | Push the release lever inwards | Spin the release lever clockwise. | Don't spin it like a nut, you need to push the lever in to clamp it. | The wheel is not safely secured to the bicycle, creating a severe safety hazard. | wrong_state | EgoExo4D | ee4d_georgiatech_bike_02_11 | Complete the Install a Wheel correctly | ego | false | 6.5 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 3,
"motion_coherence": 4,
"visual_quality": 3
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/georgiatech_bike_02_11/frame_aligned_videos/downscaled/448/aria02_214-1.mp4 | {
"step_index": 14.383,
"want_s": 8.451,
"aligned_source_interval": [
1.478925,
8.451
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_02_11_E01_substitution_01ae28a0/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_02_11_E01_substitution_01ae28a0/error_context.mp4",
"correct_c... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_02_11_E01_substitution_01ae28a0",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 1,
"error_end_s": 5,
"visible_error": "视频2中，操作者像拧螺母一样顺时针旋转快拆杆，而不是将其向内推以夹紧定位。",
"difference_from_correct": "正确步骤应将车轮正确装入并最终将快拆杆向内推紧以锁定；而视频2中则是旋转快拆杆，这无... | {
"source_duration_s": 87.87,
"crop_start_s": 0,
"crop_end_s": 87.87,
"duration_s": 87.87,
"source_replacement_start_s": 14.383,
"source_replacement_end_s": 22.834,
"error_start_s": 14.383,
"error_end_s": 22.834,
"help_point_s": 15.383,
"duration_status": "within_target",
"continuity_policy": "ful... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiate... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_02_11_E01_substitution_01ae28a0/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiate... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:26:34.571241+00:00"
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_04_2_E02_wrong_execution_5dd98552 | wrong_execution | execution_deviation | Release caliper rim brake pads | Squeeze the brake caliper arms together against the rim. | You don't need to squeeze the arms, just flip the little release lever on the side to open the brakes. | The wheel will get stuck on the brake pads when the person tries to pull it out of the frame, preventing removal. | wrong_state | EgoExo4D | ee4d_georgiatech_bike_04_2 | Complete the Remove a Wheel correctly | ego | false | 4.458 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 2,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | promoted_after_review | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/georgiatech_bike_04_2/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 24.024,
"want_s": 3.013,
"aligned_source_interval": [
0.225975,
3.013
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_04_2_E02_wrong_execution_5dd98552/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_04_2_E02_wrong_execution_5dd98552/error_context.mp4",
"corre... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_04_2_E02_wrong_execution_5dd98552",
"label": "有问题",
"confidence": 0.7,
"error_start_s": 0,
"error_end_s": 3,
"visible_error": "操作者用手捏紧刹车夹器，而不是直接拨动释放杆来释放刹车。",
"difference_from_correct": "视频1中操作者正确释放了刹车，而视频2中操作者错误地捏紧了夹器。",
"physics_chec... | {
"source_duration_s": 42.57,
"crop_start_s": 0,
"crop_end_s": 42.57,
"duration_s": 42.57,
"source_replacement_start_s": 24.024,
"source_replacement_end_s": 27.037,
"error_start_s": 24.024,
"error_end_s": 27.037,
"help_point_s": 24.024,
"duration_status": "short_source",
"continuity_policy": "full... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiate... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_04_2_E02_wrong_execution_5dd98552/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgia... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:26:48.832943+00:00"
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_05_6_E01_substitution_59b87f28 | substitution | object_or_predicate_swap | Pull the lever outward and turn the axle CCW until axle can be removed | Turn the quick-release lever counter-clockwise without pulling it outward first. | You need to pull that lever open before you start unscrewing it. | The clamping force on the dropouts is not released, making it impossible to drop the wheel out of the fork. | wrong_state | EgoExo4D | ee4d_georgiatech_bike_05_6 | Complete the Remove a Wheel correctly | ego | false | 9 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/georgiatech_bike_05_6/frame_aligned_videos/downscaled/448/aria01_214-1.mp4 | {
"step_index": 14.105,
"want_s": 10.04,
"aligned_source_interval": [
0,
10.04
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_05_6_E01_substitution_59b87f28/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_05_6_E01_substitution_59b87f28/error_context.mp4",
"correct_cli... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_05_6_E01_substitution_59b87f28",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 2,
"error_end_s": 8,
"visible_error": "在未将快拆杆向外扳开（释放夹紧力）的情况下，直接逆时针旋转快拆杆。",
"difference_from_correct": "正确动作中，需要先将快拆杆向外扳开以释放夹紧力，然后再旋转拆卸；而视频2中直接在闭合状态下旋转... | {
"source_duration_s": 35.77,
"crop_start_s": 0,
"crop_end_s": 35.77,
"duration_s": 35.77,
"source_replacement_start_s": 14.105,
"source_replacement_end_s": 24.145,
"error_start_s": 14.105,
"error_end_s": 24.145,
"help_point_s": 16.105,
"duration_status": "short_source",
"continuity_policy": "full... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiate... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_05_6_E01_substitution_59b87f28/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatec... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:27:00.595820+00:00"
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_06_10_E01_wrong_execution_aa083c4f | wrong_execution | execution_deviation | Engage a tire lever anywhere on the rim except right at the valve | Engage the tire lever right at the valve stem. | Don't pry right at the valve, you might tear the tube! | Tearing the valve base destroys the inner tube, making it impossible to inflate the tire and complete the repair. | wrong_destination | EgoExo4D | ee4d_georgiatech_bike_06_10 | Complete the Fix a Flat Tire - Replace a Bike Tube correctly | ego | false | 6.625 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 3,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/georgiatech_bike_06_10/frame_aligned_videos/downscaled/448/aria05_214-1.mp4 | {
"step_index": 53.091,
"want_s": 6.438,
"aligned_source_interval": [
1.7704499999999999,
6.438
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_06_10_E01_wrong_execution_aa083c4f/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_06_10_E01_wrong_execution_aa083c4f/error_context.mp4",
"cor... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_06_10_E01_wrong_execution_aa083c4f",
"label": "有问题",
"confidence": 0.7,
"error_start_s": 0,
"error_end_s": 6,
"visible_error": "撬胎棒直接插在气门嘴正上方进行撬胎，这容易损坏气门嘴处的内胎。",
"difference_from_correct": "正确视频中撬胎棒避开了气门嘴位置，而错误视频中直接在气门嘴处使用撬胎棒。",
"phys... | {
"source_duration_s": 272.93,
"crop_start_s": 0,
"crop_end_s": 120,
"duration_s": 120,
"source_replacement_start_s": 53.091,
"source_replacement_end_s": 59.529,
"error_start_s": 53.091,
"error_end_s": 59.529,
"help_point_s": 53.091,
"duration_status": "within_target",
"continuity_policy": "120s_e... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiate... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_06_10_E01_wrong_execution_aa083c4f/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgi... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:27:15.810059+00:00"
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_06_4_E01_substitution_c1ca1373 | substitution | object_or_predicate_swap | Get bike tire lever | Get a flathead screwdriver. | Don't use a screwdriver, you'll puncture the tube; get a proper tire lever. | Using a screwdriver to pry the tire onto or off the rim will almost certainly pinch and puncture the inner tube, ruining the repair. | wrong_object | EgoExo4D | ee4d_georgiatech_bike_06_4 | Complete the Fix a Flat Tire - Replace a Bike Tube correctly | ego | false | 3.167 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 3,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/georgiatech_bike_06_4/frame_aligned_videos/downscaled/448/aria05_214-1.mp4 | {
"step_index": 33.649,
"want_s": 2.794,
"aligned_source_interval": [
0.76835,
2.794
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_06_4_E01_substitution_c1ca1373/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_06_4_E01_substitution_c1ca1373/error_context.mp4",
"correct_cli... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_06_4_E01_substitution_c1ca1373",
"label": "有问题",
"confidence": 0.95,
"error_start_s": 0,
"error_end_s": 2,
"visible_error": "视频中使用了平口螺丝刀来撬轮胎，而不是使用正确的自行车撬胎棒。",
"difference_from_correct": "正确做法是使用黄色的塑料撬胎棒，而视频2中错误地拿取并使用了金属平口螺丝刀，这极易划伤或刺破内胎。... | {
"source_duration_s": 312.4,
"crop_start_s": 0,
"crop_end_s": 120,
"duration_s": 120,
"source_replacement_start_s": 33.649,
"source_replacement_end_s": 36.443,
"error_start_s": 33.649,
"error_end_s": 36.443,
"help_point_s": 33.649,
"duration_status": "within_target",
"continuity_policy": "120s_ev... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiate... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_06_4_E01_substitution_c1ca1373/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatec... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:29:51.096619+00:00"
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_07_6_E03_wrong_execution_dd65a88a | wrong_execution | execution_deviation | Rotate the pedal | Rotate the pedal backwards. | Turn the pedal forwards so the chain actually moves and catches on the gears. | The chain fails to seat on the cassette, leaving the wheel improperly installed and the drivetrain unengaged. | wrong_state | EgoExo4D | ee4d_georgiatech_bike_07_6 | Complete the Install a Wheel correctly | ego | false | 10 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 2,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | promoted_after_review | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/georgiatech_bike_07_6/frame_aligned_videos/downscaled/448/aria06_214-1.mp4 | {
"step_index": 48.406,
"want_s": 7.064,
"aligned_source_interval": [
0,
6.5342
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_07_6_E03_wrong_execution_dd65a88a/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_07_6_E03_wrong_execution_dd65a88a/error_context.mp4",
"corre... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_07_6_E03_wrong_execution_dd65a88a",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 3,
"error_end_s": 6,
"visible_error": "操作者反向旋转脚踏板，导致链条无法正确挂合在飞轮齿轮上。",
"difference_from_correct": "正确动作应正向旋转脚踏板以带动链条和车轮，而视频2中反向旋转脚踏板。",
"physics_ch... | {
"source_duration_s": 61.13,
"crop_start_s": 0,
"crop_end_s": 61.13,
"duration_s": 61.13,
"source_replacement_start_s": 48.406,
"source_replacement_end_s": 55.47,
"error_start_s": 48.406,
"error_end_s": 55.47,
"help_point_s": 51.406,
"duration_status": "within_target",
"continuity_policy": "full_... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiate... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_07_6_E03_wrong_execution_dd65a88a/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgia... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:31:00.274130+00:00"
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_11_2_E01_substitution_f848032f | substitution | object_or_predicate_swap | Pull the release lever outwards | Rotate the release lever counter-clockwise. | Don't just turn it, you have to pull the lever outwards to flip it open. | The wheel remains secured to the dropouts because the cam tension hasn't been released, preventing the wheel from dropping out. | wrong_state | EgoExo4D | ee4d_georgiatech_bike_11_2 | Complete the Remove a Wheel correctly | ego | false | 4.875 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 3,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/georgiatech_bike_11_2/frame_aligned_videos/downscaled/448/aria05_214-1.mp4 | {
"step_index": 7.279,
"want_s": 3.634,
"aligned_source_interval": [
0.27255,
3.36145
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_11_2_E01_substitution_f848032f/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_11_2_E01_substitution_f848032f/error_context.mp4",
"correct_cli... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_11_2_E01_substitution_f848032f",
"label": "有问题",
"confidence": 0.9,
"error_start_s": 0,
"error_end_s": 4,
"visible_error": "视频2中，操作者直接逆时针旋转快拆杆，而没有先向外拉开（翻开）快拆杆。",
"difference_from_correct": "正确步骤应该先向外拉开快拆杆以释放张力，而视频2中直接进行旋转，导致无法正确释放车轮。",
... | {
"source_duration_s": 21.37,
"crop_start_s": 0,
"crop_end_s": 21.37,
"duration_s": 21.37,
"source_replacement_start_s": 7.279,
"source_replacement_end_s": 10.913,
"error_start_s": 7.279,
"error_end_s": 10.913,
"help_point_s": 7.279,
"duration_status": "short_source",
"continuity_policy": "full_so... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiate... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_11_2_E01_substitution_f848032f/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatec... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:31:08.858357+00:00"
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_11_4_E01_wrong_execution_2c9a890d | wrong_execution | execution_deviation | Get a new inner tube | Pick up the old, punctured inner tube. | Wait, you're grabbing the old flat tube instead of the new one! | Reinstalling a punctured tube means the tire will not hold air when inflated, failing the task. | wrong_object | EgoExo4D | ee4d_georgiatech_bike_11_4 | Complete the Fix a Flat Tire - Replace a Bike Tube correctly | ego | false | 6.5 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 2,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | promoted_after_review | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/georgiatech_bike_11_4/frame_aligned_videos/downscaled/448/aria05_214-1.mp4 | {
"step_index": 294.605,
"want_s": 13.511,
"aligned_source_interval": [
2.3644249999999998,
13.511
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_11_4_E01_wrong_execution_2c9a890d/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_11_4_E01_wrong_execution_2c9a890d/error_context.mp4",
"corre... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_11_4_E01_wrong_execution_2c9a890d",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 1,
"error_end_s": 6,
"visible_error": "操作者拿起了桌上的旧内胎，而非从橙色盒子中取出新内胎。",
"difference_from_correct": "正确动作是从包装盒中取出新内胎；错误动作是直接拿取桌上的旧内胎。",
"physics_check... | {
"source_duration_s": 483.7,
"crop_start_s": 234.605,
"crop_end_s": 354.605,
"duration_s": 120,
"source_replacement_start_s": 294.605,
"source_replacement_end_s": 308.116,
"error_start_s": 60,
"error_end_s": 73.511,
"help_point_s": 61,
"duration_status": "within_target",
"continuity_policy": "120... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiate... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_11_4_E01_wrong_execution_2c9a890d/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgia... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:31:11.907676+00:00"
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_16_14_E01_wrong_execution_97c9d673 | wrong_execution | execution_deviation | Get bike tire lever | Get a flathead screwdriver. | Don't use a screwdriver for that, you'll puncture the tube or scratch the rim! | The sharp metal tip of the screwdriver pinches the rubber tube against the hard rim, creating a new puncture and ruining the repair. | wrong_object | EgoExo4D | ee4d_georgiatech_bike_16_14 | Complete the Fix a Flat Tire - Replace a Bike Tube correctly | ego | false | 5.583 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 4,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/georgiatech_bike_16_14/frame_aligned_videos/downscaled/448/aria03_214-1.mp4 | {
"step_index": 0,
"want_s": 10.818,
"aligned_source_interval": [
7.302149999999999,
10.818
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_16_14_E01_wrong_execution_97c9d673/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_16_14_E01_wrong_execution_97c9d673/error_context.mp4",
"cor... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_16_14_E01_wrong_execution_97c9d673",
"label": "有问题",
"confidence": 0.8,
"error_start_s": 0,
"error_end_s": 5.5,
"visible_error": "视频2中展示了使用一字螺丝刀代替自行车撬胎棒，这可能会损坏内胎或车圈。",
"difference_from_correct": "视频1中正确拿取了黄色的撬胎棒，而视频2中拿取并展示了一把黄色手柄的一字螺丝刀。... | {
"source_duration_s": 232.4,
"crop_start_s": 0,
"crop_end_s": 120,
"duration_s": 120,
"source_replacement_start_s": 0,
"source_replacement_end_s": 10.818,
"error_start_s": 0,
"error_end_s": 10.818,
"help_point_s": 0,
"duration_status": "within_target",
"continuity_policy": "120s_event_centered",
... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiate... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_16_14_E01_wrong_execution_97c9d673/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgi... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:31:24.110061+00:00"
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_16_6_E01_wrong_execution_4ee243ec | wrong_execution | execution_deviation | Push the release lever inwards | Pull the release lever outwards. | Push the lever inwards to release it, don't pull it out. | The axle remains closed, preventing the wheel from sliding into the frame's dropouts. | wrong_state | EgoExo4D | ee4d_georgiatech_bike_16_6 | Complete the Install a Wheel correctly | ego | false | 5.792 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 4,
"source_fidelity": 3,
"action_timing": 4,
"motion_coherence": 4,
"visual_quality": 4
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/georgiatech_bike_16_6/frame_aligned_videos/downscaled/448/aria03_214-1.mp4 | {
"step_index": 95.083,
"want_s": 3.604,
"aligned_source_interval": [
0,
3.604
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_16_6_E01_wrong_execution_4ee243ec/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_16_6_E01_wrong_execution_4ee243ec/error_context.mp4",
"corre... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_16_6_E01_wrong_execution_4ee243ec",
"label": "有问题",
"confidence": 0.75,
"error_start_s": 1,
"error_end_s": 4,
"visible_error": "操作者向外拉动快拆杆，未将其向内推紧锁定。",
"difference_from_correct": "正确动作应向内推紧快拆杆，而视频2中操作者将其向外拉开。",
"physics_check": "通过",
... | {
"source_duration_s": 177.17,
"crop_start_s": 0,
"crop_end_s": 177.17,
"duration_s": 177.17,
"source_replacement_start_s": 95.083,
"source_replacement_end_s": 98.687,
"error_start_s": 95.083,
"error_end_s": 98.687,
"help_point_s": 96.083,
"duration_status": "within_target",
"continuity_policy": "... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiate... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_16_6_E01_wrong_execution_4ee243ec/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgia... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:31:30.840110+00:00"
} |
v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_19_12_E02_wrong_execution_ce5f9a9c | wrong_execution | execution_deviation | Use a cloth to dry off any liquid on the chain | Dab the cloth on a single section of the chain without rotating the pedals. | Hold the cloth around the chain and spin the pedals backward to dry the whole thing. | The remaining liquid prevents the lubricant from working, leading to a noisy, poorly lubricated chain that may rust. | wrong_state | EgoExo4D | ee4d_georgiatech_bike_19_12 | Complete the Clean and Lubricate the Chain correctly | ego | false | 5.708 | {
"error_semantics": 4,
"error_type_match": 4,
"visual_observability": 4,
"task_impact": 3,
"source_fidelity": 3,
"action_timing": 3,
"motion_coherence": 3,
"visual_quality": 3
} | {
"source": "448x448",
"generated": "720x720",
"exact_size_match": false,
"aspect_preserved": true,
"area_ratio": 2.583
} | passed_lean_gates | <source>/resolved_sources/long_video/C_ego_general/EgoExo4D/takes/georgiatech_bike_19_12/frame_aligned_videos/downscaled/448/aria05_214-1.mp4 | {
"step_index": 47.429,
"want_s": 9.006,
"aligned_source_interval": [
0,
9.006
]
} | {
"correct_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_19_12_E02_wrong_execution_ce5f9a9c/correct_context.mp4",
"error_context": "generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_19_12_E02_wrong_execution_ce5f9a9c/error_context.mp4",
"cor... | {
"sample_id": "v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_19_12_E02_wrong_execution_ce5f9a9c",
"label": "有问题",
"confidence": 0.7,
"error_start_s": 1,
"error_end_s": 5,
"visible_error": "操作者仅用抹布擦拭链条局部，未转动脚踏板。",
"difference_from_correct": "正确动作旋转脚踏板干燥整条链条，错误动作仅擦拭局部且未旋转脚踏板。",
"physics_check": "... | {
"source_duration_s": 201.6,
"crop_start_s": 0,
"crop_end_s": 120,
"duration_s": 120,
"source_replacement_start_s": 47.429,
"source_replacement_end_s": 56.435,
"error_start_s": 47.429,
"error_end_s": 56.435,
"help_point_s": 48.429,
"duration_status": "within_target",
"continuity_policy": "120s_ev... | generation_error | {
"origin": "dataset_v2_context_pairs_full",
"publication": "UnifiedProactiveBench/generation_error/v1",
"source_manifest_original": "<source>/dataset_v2_context_pairs_full/manifest.jsonl",
"source_metadata_original": "<source>/dataset_v2_context_pairs_full/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiate... | {
"correct_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgiatech_bike_19_12_E02_wrong_execution_ce5f9a9c/correct_context.mp4",
"error_context": "<source>/UnifiedProactiveBench/data/generation_error/samples/v2_dataset_v2_batch3_egoexo4d_A_ee4d_georgi... | {
"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2,
"reviewer": "cy",
"reviewed_at": "2026-08-28T05:31:37.408061+00:00"
} |
End of preview. Expand in Data Studio
UPBench-Error-verified-v2
LCZZZZ/UPBench-Error → generation_error 子集，经两轮人工核验后保留的
1,219 条样本。每条样本视觉上看不出明显的低级生成缺陷。
筛选过程
| 步骤 | 剩余 |
|---|---|
原始 generation_error 样本 |
5,761 |
剔除 is_gui=true（GUI-World / egoproactive 屏幕录制） |
3,390 |
第一轮：逐条过目 error_clip.mp4 |
good 1,420 / bad 1,970 |
| 第二轮：对第一轮 good 再过一遍 | good 1,219 / bad 201 |
第二轮刷掉了第一轮 14.2% 的样本，最终保留率 1,219 / 3,390 = 36.0%。
内容
metadata/manifest-verified.jsonl 1,219 条，原 manifest 全部 25 个字段逐字保留，
另加 human_verification 字段
metadata/summary.json 统计摘要
generation_error/samples/<sample_id>/
error_clip.mp4 AI 生成的错误片段
error_context.mp4 完整上下文：真实前段 + 尾部生成段
correct_clip.mp4 配对的正确片段（真实拍摄）
correct_context.mp4 配对的完整上下文（全程真实）
视频路径与原数据集同构，可直接用 manifest 里的 files 字段定位：
rec["files"]["error_clip"]
# -> generation_error/samples/<sample_id>/error_clip.mp4
human_verification 字段：
{"label": "good",
"meaning": "no obvious low-level generation artifact",
"passes": 2, "reviewer": "...", "reviewed_at": "..."}
其余字段（error_type / correct_step / error_step / expected_correction /
failure_mechanism / audit / pair / temporal / geometry …）
与原数据集逐字一致，未做任何改写或翻译。
构成
| error_type | 数量 |
|---|---|
| wrong_execution | 704 |
| substitution | 515 |
| 上游数据集 | 数量 |
|---|---|
| EgoExo4D | 557 |
| EgoExoLearn | 453 |
| ENIGMA-360 | 45 |
| egoproactive | 32 |
| EgoLife | 27 |
| BARISTA | 24 |
| KS-Gen/COIN | 22 |
| 其余 | 59 |
许可
沿用原数据集的 source-dataset-terms。素材来自 EgoExo4D、EgoExoLearn、
ENIGMA-360、HoloAssist 等上游数据集，各自的使用协议依然适用。
使用前请确认你已获得相应上游数据集的授权。
- Downloads last month
- -