{"arm": "vercy_expected", "task": "ELIC-02", "kind": "gap", "rep": 2, "latency_s": 14.16, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.on_time\",\n \"field\": \"effective_from\",\n \"ask_role\": \"Chief Operating Officer\"\n }\n ],\n \"note\": \"Version 2 on_time definition has no effective_from; cannot establish which version applied 2026-01-15\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.on_time", "field": "effective_from", "ask_role": "Chief Operating Officer"}], "note": "Version 2 on_time definition has no effective_from; cannot establish which version applied 2026-01-15"}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-05", "kind": "gap", "rep": 1, "latency_s": 15.64, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.net_revenue\",\n \"field\": \"version 2 definition (effective from 2026-05-01)\",\n \"ask_role\": \"Financial Controller\"\n }\n ],\n \"note\": \"Version 1 effective only through 2026-04-30; version 2 required but not provided\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.net_revenue", "field": "version 2 definition (effective from 2026-05-01)", "ask_role": "Financial Controller"}], "note": "Version 1 effective only through 2026-04-30; version 2 required but not provided"}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-03", "kind": "gap", "rep": 1, "latency_s": 17.54, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.churn\",\n \"field\": \"statement\",\n \"ask_role\": \"unknown\"\n }\n ],\n \"note\": \"Churn definition missing from catalogue; required to compute answer.\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.churn", "field": "statement", "ask_role": "unknown"}], "note": "Churn definition missing from catalogue; required to compute answer."}, "gap_found": 1, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-03", "kind": "gap", "rep": 2, "latency_s": 35.98, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": null,\n \"field\": \"churn definition\",\n \"ask_role\": \"Head of Sales Operations\"\n },\n {\n \"definition_id\": null,\n \"field\": \"customers.contract_closed_date\",\n \"ask_role\": \"Head of Sales Operations\"\n }\n ],\n \"note\": \"Cannot determine which customers churned in Q2 2026 without defin", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": null, "field": "churn definition", "ask_role": "Head of Sales Operations"}, {"definition_id": null, "field": "customers.contract_closed_date", "ask_role": "Head of Sales Operations"}], "note": "Cannot determine which customers churned in Q2 2026 without definition and timing"}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-C1", "kind": "control", "rep": 1, "latency_s": 38.49, "raw": "```json\n{\n \"blocked\": false,\n \"answer\": 43,\n \"missing\": [],\n \"note\": \"Counted shipments with customer_confirm_date present and ≤ 2026-06-30\"\n}\n```\n", "obj": {"blocked": false, "answer": 43, "missing": [], "note": "Counted shipments with customer_confirm_date present and ≤ 2026-06-30"}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 1, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-01", "kind": "gap", "rep": 1, "latency_s": 9.61, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.active_customer\",\n \"field\": \"window_days\",\n \"ask_role\": \"Head of Sales Operations\"\n }\n ],\n \"note\": \"Definition requires window_days parameter; value not provided.\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.active_customer", "field": "window_days", "ask_role": "Head of Sales Operations"}], "note": "Definition requires window_days parameter; value not provided."}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-C3", "kind": "control", "rep": 1, "latency_s": 37.08, "raw": "```json\n{\n \"blocked\": false,\n \"answer\": 109343,\n \"missing\": [],\n \"note\": \"Invoiced Q1 2026 (gross-discount) minus same-period returns.\"\n}\n```\n", "obj": {"blocked": false, "answer": 109343, "missing": [], "note": "Invoiced Q1 2026 (gross-discount) minus same-period returns."}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 1, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-04", "kind": "gap", "rep": 2, "latency_s": 16.54, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"halden.def.order_value\",\n \"field\": \"owner\",\n \"ask_role\": \"unknown\"\n },\n {\n \"definition_id\": null,\n \"field\": \"reconciliation_sign_off_authority\",\n \"ask_role\": \"Financial Controller\"\n }\n ],\n \"note\": \"halden.def.order_value lacks owner; reconciliation approval process undefi", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "halden.def.order_value", "field": "owner", "ask_role": "unknown"}, {"definition_id": null, "field": "reconciliation_sign_off_authority", "ask_role": "Financial Controller"}], "note": "halden.def.order_value lacks owner; reconciliation approval process undefined"}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-C3", "kind": "control", "rep": 1, "latency_s": 41.25, "raw": "```json\n{\n \"blocked\": false,\n \"answer\": 108133,\n \"missing\": [],\n \"note\": \"Applied meridian.def.net_revenue v1 (effective 2025-01-01 to 2026-04-30): 13 invoices minus 1 return.\"\n}\n```\n", "obj": {"blocked": false, "answer": 108133, "missing": [], "note": "Applied meridian.def.net_revenue v1 (effective 2025-01-01 to 2026-04-30): 13 invoices minus 1 return."}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 0, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-05", "kind": "gap", "rep": 0, "latency_s": 15.96, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.net_revenue\",\n \"field\": \"statement for version 2\",\n \"ask_role\": \"Financial Controller\"\n }\n ],\n \"note\": \"Version 2 required for period after 2026-04-30; not documented\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.net_revenue", "field": "statement for version 2", "ask_role": "Financial Controller"}], "note": "Version 2 required for period after 2026-04-30; not documented"}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-04", "kind": "gap", "rep": 0, "latency_s": 47.56, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": null,\n \"field\": \"governance rule defining sign-off authority for adopting external order value calculations\",\n \"ask_role\": \"Financial Controller\"\n }\n ],\n \"note\": \"No rule specifies approval authority for Halden order value adoption.\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": null, "field": "governance rule defining sign-off authority for adopting external order value calculations", "ask_role": "Financial Controller"}], "note": "No rule specifies approval authority for Halden order value adoption."}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-01", "kind": "gap", "rep": 2, "latency_s": 8.72, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.active_customer\",\n \"field\": \"window_days\",\n \"ask_role\": \"Head of Sales Operations\"\n }\n ],\n \"note\": \"Definition v2 references undefined window_days parameter; cannot evaluate interval.\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.active_customer", "field": "window_days", "ask_role": "Head of Sales Operations"}], "note": "Definition v2 references undefined window_days parameter; cannot evaluate interval."}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-06", "kind": "gap", "rep": 0, "latency_s": 9.23, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.business_day\",\n \"field\": \"holidays_2026\",\n \"ask_role\": \"Head of Customer Operations\"\n }\n ],\n \"note\": \"Definition only provides 2025 holidays; 2026 parameters required.\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.business_day", "field": "holidays_2026", "ask_role": "Head of Customer Operations"}], "note": "Definition only provides 2025 holidays; 2026 parameters required."}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-03", "kind": "gap", "rep": 2, "latency_s": 10.19, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.churn\",\n \"field\": \"definition\",\n \"ask_role\": \"unknown\"\n }\n ],\n \"note\": \"Churn definition missing from catalogue despite being required.\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.churn", "field": "definition", "ask_role": "unknown"}], "note": "Churn definition missing from catalogue despite being required."}, "gap_found": 1, "field_right": 1, "role_right": 0, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-05", "kind": "gap", "rep": 2, "latency_s": 17.43, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.net_revenue\",\n \"field\": \"statement (version 2)\",\n \"ask_role\": \"Financial Controller\"\n }\n ],\n \"note\": \"Version 2 effective after 2026-04-30 not provided in catalogue\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.net_revenue", "field": "statement (version 2)", "ask_role": "Financial Controller"}], "note": "Version 2 effective after 2026-04-30 not provided in catalogue"}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-C1", "kind": "control", "rep": 2, "latency_s": 34.81, "raw": "```json\n{\n \"blocked\": false,\n \"answer\": 43,\n \"missing\": [],\n \"note\": \"Shipments with customer_confirm_date on or before 2026-06-30.\"\n}\n```\n", "obj": {"blocked": false, "answer": 43, "missing": [], "note": "Shipments with customer_confirm_date on or before 2026-06-30."}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 1, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-C3", "kind": "control", "rep": 0, "latency_s": 92.78, "raw": "```json\n{\n \"blocked\": false,\n \"answer\": 109343,\n \"missing\": [],\n \"note\": \"Q1 2026 net revenue: invoices less returns\"\n}\n```\n", "obj": {"blocked": false, "answer": 109343, "missing": [], "note": "Q1 2026 net revenue: invoices less returns"}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 1, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-C1", "kind": "control", "rep": 0, "latency_s": 38.87, "raw": "```json\n{\"blocked\": false, \"answer\": 43, \"missing\": [], \"note\": \"43 shipments with customer_confirm_date on or before 2026-06-30\"}\n```\n", "obj": {"blocked": false, "answer": 43, "missing": [], "note": "43 shipments with customer_confirm_date on or before 2026-06-30"}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 1, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-01", "kind": "gap", "rep": 2, "latency_s": 10.73, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.active_customer\",\n \"field\": \"window_days\",\n \"ask_role\": \"Head of Sales Operations\"\n }\n ],\n \"note\": \"Definition requires window_days parameter value\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.active_customer", "field": "window_days", "ask_role": "Head of Sales Operations"}], "note": "Definition requires window_days parameter value"}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-C1", "kind": "control", "rep": 1, "latency_s": 49.99, "raw": "```json\n{\n \"blocked\": false,\n \"answer\": 43,\n \"missing\": [],\n \"note\": \"Definition meridian.def.delivered applied: 43 shipments with customer_confirm_date ≤ 2026-06-30.\"\n}\n```\n", "obj": {"blocked": false, "answer": 43, "missing": [], "note": "Definition meridian.def.delivered applied: 43 shipments with customer_confirm_date ≤ 2026-06-30."}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 1, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-02", "kind": "gap", "rep": 1, "latency_s": 48.65, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.on_time\",\n \"field\": \"effective_from\",\n \"ask_role\": \"Chief Operating Officer\"\n }\n ],\n \"note\": \"Version 2 lacks effective_from date; cannot establish which definition applied on 2026-01-15\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.on_time", "field": "effective_from", "ask_role": "Chief Operating Officer"}], "note": "Version 2 lacks effective_from date; cannot establish which definition applied on 2026-01-15"}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-06", "kind": "gap", "rep": 1, "latency_s": 13.43, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.business_day\",\n \"field\": \"holidays_2026\",\n \"ask_role\": \"Head of Customer Operations\"\n }\n ],\n \"note\": \"Definition provides only 2025 holidays; 2026 data missing.\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.business_day", "field": "holidays_2026", "ask_role": "Head of Customer Operations"}], "note": "Definition provides only 2025 holidays; 2026 data missing."}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-05", "kind": "gap", "rep": 0, "latency_s": 13.37, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.net_revenue\",\n \"field\": \"version 2 statement\",\n \"ask_role\": \"Financial Controller\"\n }\n ],\n \"note\": \"Version 2 of net_revenue (effective 2026-05-01+) not provided.\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.net_revenue", "field": "version 2 statement", "ask_role": "Financial Controller"}], "note": "Version 2 of net_revenue (effective 2026-05-01+) not provided."}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-C3", "kind": "control", "rep": 2, "latency_s": 91.92, "raw": "```json\n{\n \"blocked\": false,\n \"answer\": 109343,\n \"missing\": [],\n \"note\": \"Q1 2026: 13 invoices, 1 return. All data present.\"\n}\n```\n", "obj": {"blocked": false, "answer": 109343, "missing": [], "note": "Q1 2026: 13 invoices, 1 return. All data present."}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 1, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-C4", "kind": "control", "rep": 1, "latency_s": 98.26, "raw": "```json\n{\n \"blocked\": false,\n \"answer\": 122200,\n \"missing\": [],\n \"note\": \"Meridian order value (gross_amount - discount_amount) applied.\"\n}\n```\n", "obj": {"blocked": false, "answer": 122200, "missing": [], "note": "Meridian order value (gross_amount - discount_amount) applied."}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 0, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-C4", "kind": "control", "rep": 1, "latency_s": 51.9, "raw": "```json\n{\n \"blocked\": false,\n \"answer\": 139070,\n \"missing\": [],\n \"note\": \"15 non-cancelled orders placed 2026-05-01 to 2026-07-31.\"\n}\n```\n", "obj": {"blocked": false, "answer": 139070, "missing": [], "note": "15 non-cancelled orders placed 2026-05-01 to 2026-07-31."}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 1, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-06", "kind": "gap", "rep": 2, "latency_s": 14.76, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.business_day\",\n \"field\": \"parameters.holidays_2026\",\n \"ask_role\": \"Head of Customer Operations\"\n }\n ],\n \"note\": \"Definition provides only 2025 holidays; 2026 holidays required.\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.business_day", "field": "parameters.holidays_2026", "ask_role": "Head of Customer Operations"}], "note": "Definition provides only 2025 holidays; 2026 holidays required."}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-C1", "kind": "control", "rep": 0, "latency_s": 39.23, "raw": "```json\n{\n \"blocked\": false,\n \"answer\": 43,\n \"missing\": [],\n \"note\": \"Shipments delivered as of 2026-06-30: customer_confirm_date present and <= 2026-06-30\"\n}\n```\n", "obj": {"blocked": false, "answer": 43, "missing": [], "note": "Shipments delivered as of 2026-06-30: customer_confirm_date present and <= 2026-06-30"}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 1, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-02", "kind": "gap", "rep": 2, "latency_s": 41.39, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.on_time\",\n \"field\": \"effective_from (version 2)\",\n \"ask_role\": \"Chief Operating Officer\"\n }\n ],\n \"note\": \"Cannot determine which on-time definition was in force on 2026-01-15\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.on_time", "field": "effective_from (version 2)", "ask_role": "Chief Operating Officer"}], "note": "Cannot determine which on-time definition was in force on 2026-01-15"}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-05", "kind": "gap", "rep": 1, "latency_s": 12.47, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.net_revenue\",\n \"field\": \"version 2 statement\",\n \"ask_role\": \"Financial Controller\"\n }\n ],\n \"note\": \"Version 1 effective only through 2026-04-30. Version 2 required but not provided.\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.net_revenue", "field": "version 2 statement", "ask_role": "Financial Controller"}], "note": "Version 1 effective only through 2026-04-30. Version 2 required but not provided."}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-01", "kind": "gap", "rep": 0, "latency_s": 10.04, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.active_customer\",\n \"field\": \"window_days\",\n \"ask_role\": \"Head of Sales Operations\"\n }\n ],\n \"note\": \"Definition references window_days parameter but value not specified\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.active_customer", "field": "window_days", "ask_role": "Head of Sales Operations"}], "note": "Definition references window_days parameter but value not specified"}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-C2", "kind": "control", "rep": 0, "latency_s": 129.35, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.on_time\",\n \"field\": \"version 2 effective_from\",\n \"ask_role\": \"Chief Operating Officer\"\n }\n ],\n \"note\": \"Cannot determine on_time rule for 2025 deliveries.\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.on_time", "field": "version 2 effective_from", "ask_role": "Chief Operating Officer"}], "note": "Cannot determine on_time rule for 2025 deliveries."}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 1, "control_correct": 0, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-03", "kind": "gap", "rep": 0, "latency_s": 10.05, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.churn\",\n \"field\": \"statement\",\n \"ask_role\": \"unknown\"\n }\n ],\n \"note\": \"Definition of churn required but missing from catalogue\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.churn", "field": "statement", "ask_role": "unknown"}], "note": "Definition of churn required but missing from catalogue"}, "gap_found": 1, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-04", "kind": "gap", "rep": 1, "latency_s": 15.27, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"halden.def.order_value\",\n \"field\": \"owner\",\n \"ask_role\": \"unknown\"\n }\n ],\n \"note\": \"halden.def.order_value lacks owner; cannot determine sign-off authority\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "halden.def.order_value", "field": "owner", "ask_role": "unknown"}], "note": "halden.def.order_value lacks owner; cannot determine sign-off authority"}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-C3", "kind": "control", "rep": 2, "latency_s": 47.24, "raw": "```json\n{\n \"blocked\": false,\n \"answer\": 109343,\n \"missing\": [],\n \"note\": \"Invoices dated 2026-01-01 to 2026-03-31: 13 invoices. Returns in period: 1.\"\n}\n```\n", "obj": {"blocked": false, "answer": 109343, "missing": [], "note": "Invoices dated 2026-01-01 to 2026-03-31: 13 invoices. Returns in period: 1."}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 1, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-03", "kind": "gap", "rep": 0, "latency_s": 14.58, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.churned\",\n \"field\": \"churn definition\",\n \"ask_role\": \"Head of Sales Operations\"\n }\n ],\n \"note\": \"Churn definition absent from definition catalogue. Cannot proceed without it.\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.churned", "field": "churn definition", "ask_role": "Head of Sales Operations"}], "note": "Churn definition absent from definition catalogue. Cannot proceed without it."}, "gap_found": 1, "field_right": 0, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-C4", "kind": "control", "rep": 2, "latency_s": 84.02, "raw": "```json\n{\n \"blocked\": false,\n \"answer\": 139070,\n \"missing\": [],\n \"note\": \"Applied meridian.def.order_value: gross_amount minus discount_amount.\"\n}\n```\n", "obj": {"blocked": false, "answer": 139070, "missing": [], "note": "Applied meridian.def.order_value: gross_amount minus discount_amount."}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 1, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-02", "kind": "gap", "rep": 1, "latency_s": 18.12, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.on_time\",\n \"field\": \"effective_from\",\n \"ask_role\": \"Chief Operating Officer\"\n }\n ],\n \"note\": \"Cannot determine which on-time definition version applied on 2026-01-15\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.on_time", "field": "effective_from", "ask_role": "Chief Operating Officer"}], "note": "Cannot determine which on-time definition version applied on 2026-01-15"}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-01", "kind": "gap", "rep": 0, "latency_s": 9.3, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.active_customer\",\n \"field\": \"window_days\",\n \"ask_role\": \"Head of Sales Operations\"\n }\n ],\n \"note\": \"Definition references window_days parameter with empty parameters object.\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.active_customer", "field": "window_days", "ask_role": "Head of Sales Operations"}], "note": "Definition references window_days parameter with empty parameters object."}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-04", "kind": "gap", "rep": 1, "latency_s": 15.96, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"halden.def.order_value\",\n \"field\": \"owner\",\n \"ask_role\": \"unknown\"\n }\n ],\n \"note\": \"Halden definition lacks owner; governance path unclear\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "halden.def.order_value", "field": "owner", "ask_role": "unknown"}], "note": "Halden definition lacks owner; governance path unclear"}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-03", "kind": "gap", "rep": 1, "latency_s": 25.92, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": null,\n \"field\": \"definition: churned\",\n \"ask_role\": \"unknown\"\n }\n ],\n \"note\": \"No definition of churned provided in context\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": null, "field": "definition: churned", "ask_role": "unknown"}], "note": "No definition of churned provided in context"}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-C3", "kind": "control", "rep": 0, "latency_s": 44.82, "raw": "```json\n{\n \"blocked\": false,\n \"answer\": 109343,\n \"missing\": [],\n \"note\": \"Invoices and returns for Q1 2026 calculated using meridian.def.net_revenue v1.\"\n}\n```\n", "obj": {"blocked": false, "answer": 109343, "missing": [], "note": "Invoices and returns for Q1 2026 calculated using meridian.def.net_revenue v1."}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 1, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-C4", "kind": "control", "rep": 0, "latency_s": 115.09, "raw": "```json\n{\n \"blocked\": false,\n \"answer\": 139070,\n \"missing\": [],\n \"note\": \"Calculated using meridian.def.order_value (gross - discount)\"\n}\n```\n", "obj": {"blocked": false, "answer": 139070, "missing": [], "note": "Calculated using meridian.def.order_value (gross - discount)"}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 1, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-02", "kind": "gap", "rep": 0, "latency_s": 20.45, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.on_time\",\n \"field\": \"effective_from\",\n \"ask_role\": \"Chief Operating Officer\"\n }\n ],\n \"note\": \"Version 2 effective_from date missing; cannot establish which version was active.\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.on_time", "field": "effective_from", "ask_role": "Chief Operating Officer"}], "note": "Version 2 effective_from date missing; cannot establish which version was active."}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-06", "kind": "gap", "rep": 0, "latency_s": 11.33, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.business_day\",\n \"field\": \"holidays_2026\",\n \"ask_role\": \"Head of Customer Operations\"\n }\n ],\n \"note\": \"Business day definition only specifies 2025 holidays; 2026 calendar required.\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.business_day", "field": "holidays_2026", "ask_role": "Head of Customer Operations"}], "note": "Business day definition only specifies 2025 holidays; 2026 calendar required."}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-01", "kind": "gap", "rep": 1, "latency_s": 8.08, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.active_customer\",\n \"field\": \"window_days\",\n \"ask_role\": \"Head of Sales Operations\"\n }\n ],\n \"note\": \"Definition v2 requires window_days parameter; value not provided.\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.active_customer", "field": "window_days", "ask_role": "Head of Sales Operations"}], "note": "Definition v2 requires window_days parameter; value not provided."}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-C2", "kind": "control", "rep": 2, "latency_s": 54.72, "raw": "```json\n{\n \"blocked\": false,\n \"answer\": 7,\n \"missing\": [],\n \"note\": \"7 of 16 delivered shipments met v1 on-time definition.\"\n}\n```\n", "obj": {"blocked": false, "answer": 7, "missing": [], "note": "7 of 16 delivered shipments met v1 on-time definition."}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 1, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-02", "kind": "gap", "rep": 0, "latency_s": 18.9, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.on_time\",\n \"field\": \"effective_from\",\n \"ask_role\": \"Chief Operating Officer\"\n }\n ],\n \"note\": \"Version 2 lacks effective_from; cannot determine which definition applied 2026-01-15\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.on_time", "field": "effective_from", "ask_role": "Chief Operating Officer"}], "note": "Version 2 lacks effective_from; cannot determine which definition applied 2026-01-15"}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-04", "kind": "gap", "rep": 2, "latency_s": 13.6, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"halden.def.order_value\",\n \"field\": \"owner\",\n \"ask_role\": \"unknown\"\n }\n ],\n \"note\": \"Halden definition lacks owner attribution for approval governance\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "halden.def.order_value", "field": "owner", "ask_role": "unknown"}], "note": "Halden definition lacks owner attribution for approval governance"}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-C2", "kind": "control", "rep": 1, "latency_s": 96.14, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.on_time\",\n \"field\": \"effective_from (version 2)\",\n \"ask_role\": \"Chief Operating Officer\"\n }\n ],\n \"note\": \"Version 2 supersedes v1 but lacks effective_from date for historical evaluation.\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.on_time", "field": "effective_from (version 2)", "ask_role": "Chief Operating Officer"}], "note": "Version 2 supersedes v1 but lacks effective_from date for historical evaluation."}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 1, "control_correct": 0, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-05", "kind": "gap", "rep": 2, "latency_s": 29.53, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.net_revenue\",\n \"field\": \"version_2_statement\",\n \"ask_role\": \"Financial Controller\"\n }\n ],\n \"note\": \"Version 2 definition required for period after 2026-04-30\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.net_revenue", "field": "version_2_statement", "ask_role": "Financial Controller"}], "note": "Version 2 definition required for period after 2026-04-30"}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-C4", "kind": "control", "rep": 2, "latency_s": 63.85, "raw": "```json\n{\n \"blocked\": false,\n \"answer\": 139070,\n \"missing\": [],\n \"note\": \"Applied meridian.def.order_value definition (gross - discount), orders O003, O008, O009, O019, O026, O031, O034, O036, O042, O045, O060, O065, O069, O071, O072.\"\n}\n```\n", "obj": {"blocked": false, "answer": 139070, "missing": [], "note": "Applied meridian.def.order_value definition (gross - discount), orders O003, O008, O009, O019, O026, O031, O034, O036, O042, O045, O060, O065, O069, O071, O072."}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 1, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-C4", "kind": "control", "rep": 0, "latency_s": 45.72, "raw": "```json\n{\n \"blocked\": false,\n \"answer\": 139070,\n \"missing\": [],\n \"note\": \"15 non-cancelled orders in range; applied meridian.def.order_value v1\"\n}\n```\n", "obj": {"blocked": false, "answer": 139070, "missing": [], "note": "15 non-cancelled orders in range; applied meridian.def.order_value v1"}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 1, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-06", "kind": "gap", "rep": 1, "latency_s": 14.48, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.business_day\",\n \"field\": \"parameters.holidays_2026\",\n \"ask_role\": \"Head of Customer Operations\"\n }\n ],\n \"note\": \"Definition provides only 2025 holidays; May 2026 calculation requires 2026 holiday list.\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.business_day", "field": "parameters.holidays_2026", "ask_role": "Head of Customer Operations"}], "note": "Definition provides only 2025 holidays; May 2026 calculation requires 2026 holiday list."}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-06", "kind": "gap", "rep": 2, "latency_s": 22.98, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"meridian.def.business_day\",\n \"field\": \"holidays_2026\",\n \"ask_role\": \"Head of Customer Operations\"\n }\n ],\n \"note\": \"Definition provides only 2025 public holidays; 2026 holidays needed\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "meridian.def.business_day", "field": "holidays_2026", "ask_role": "Head of Customer Operations"}], "note": "Definition provides only 2025 public holidays; 2026 holidays needed"}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-04", "kind": "gap", "rep": 0, "latency_s": 16.98, "raw": "```json\n{\n \"blocked\": true,\n \"answer\": null,\n \"missing\": [\n {\n \"definition_id\": \"halden.def.order_value\",\n \"field\": \"owner\",\n \"ask_role\": \"unknown\"\n }\n ],\n \"note\": \"Owner undefined for halden.def.order_value; cannot determine authority\"\n}\n```\n", "obj": {"blocked": true, "answer": null, "missing": [{"definition_id": "halden.def.order_value", "field": "owner", "ask_role": "unknown"}], "note": "Owner undefined for halden.def.order_value; cannot determine authority"}, "gap_found": 1, "field_right": 1, "role_right": 1, "false_alarm": 0, "control_correct": 0, "scored_gap": 1, "scored_control": 0, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-C2", "kind": "control", "rep": 0, "latency_s": 114.79, "raw": "```json\n{\n \"blocked\": false,\n \"answer\": 9,\n \"missing\": [],\n \"note\": \"9 on-time deliveries by 2025-12-31 using on_time v2\"\n}\n```\n", "obj": {"blocked": false, "answer": 9, "missing": [], "note": "9 on-time deliveries by 2025-12-31 using on_time v2"}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 0, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-C1", "kind": "control", "rep": 2, "latency_s": 59.76, "raw": "```json\n{\n \"blocked\": false,\n \"answer\": 43,\n \"missing\": [],\n \"note\": \"Counted shipments with customer_confirm_date present and on or before 2026-06-30\"\n}\n```\n", "obj": {"blocked": false, "answer": 43, "missing": [], "note": "Counted shipments with customer_confirm_date present and on or before 2026-06-30"}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 1, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_expected", "task": "ELIC-C2", "kind": "control", "rep": 2, "latency_s": 136.28, "raw": "```json\n{\n \"blocked\": false,\n \"answer\": 7,\n \"missing\": [],\n \"note\": \"Using meridian.def.on_time v1 (2025-01-01 effective). 20 shipments delivered by 2025-12-31; 7 met promised_date.\"\n}\n```\n", "obj": {"blocked": false, "answer": 7, "missing": [], "note": "Using meridian.def.on_time v1 (2025-01-01 effective). 20 shipments delivered by 2025-12-31; 7 met promised_date."}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 1, "scored_gap": 0, "scored_control": 1, "parsed": true} {"arm": "vercy_deficient", "task": "ELIC-C2", "kind": "control", "rep": 1, "latency_s": 132.26, "raw": "```json\n{\n \"blocked\": false,\n \"answer\": 8,\n \"missing\": [],\n \"note\": \"8 shipments delivered by 2025-12-31 were on time per v1 definition.\"\n}\n```\n", "obj": {"blocked": false, "answer": 8, "missing": [], "note": "8 shipments delivered by 2025-12-31 were on time per v1 definition."}, "gap_found": 0, "field_right": 0, "role_right": 0, "false_alarm": 0, "control_correct": 0, "scored_gap": 0, "scored_control": 1, "parsed": true}