Published copy. Evidence paths refer to the repository branch insights/generator-benchmark.

Insights Goal B: generator benchmark (2026-09-07)

Question: is the SQL generator the lever? Same code, same prompts, same fixture, same sealed holdout and scorer for every arm; only the generator model varies.

Arms that ran: glm-5.2, glm-5.3. Arms unavailable: claude-fable-5-1, claude-opus-5, claude-sonnet-5.

Decision

Answer: with the arms that could run, no. No arm halves first-turn errors or lifts precision above 70%, and every difference against the control sits inside or beside the control's own run-to-run spread. The two arms that ran were served by the same reported model (glm-5.3), so this benchmark measured request-configuration noise, not a second generator. Whether a different generator family (claude-fable-5-1, claude-opus-5, claude-sonnet-5) changes the planner failure class is still untested: those arms had no credential. The planner failure class stays the largest first-turn cause in every arm; it is about 31 of 100 first turns in the control.

Rule: an arm wins if it halves first-turn errors, or lifts precision above 70% with the lower paired bound above the control, and the gain exceeds the control noise floor.

Arms

The provider returned model identifier glm-5.3 for every glm-5.2 request on the zai coding endpoint during the freeze probe, both smokes and every run. The standard zai endpoint refuses this account (no balance), so a served glm-5.2 is not reachable. Arms 1 and 2 are therefore two request configurations served by the same reported model.

#armprovidermodel requestedmodel returned by the providerthinkingsamplingstatusreason
1glm-5.2zaiglm-5.2glm-5.3 (1456 calls)disabledT=0, seed=42: temperature and seed sent and accepted; thinking disabled requestedavailable
2glm-5.3zaiglm-5.3glm-5.3 (1471 calls)disabledT=0, seed=42: temperature and seed sent and accepted; thinking disabled requestedavailable
3claude-fable-5-1anthropicclaude-fable-5-1not probedadaptive_lowT=0, seed=42: temperature and seed are not supported by the Messages API for this model family; not sentunavailableNo ANTHROPIC_API_KEY in the private credential setup (.envrc.local, process environment, ~/.config). Claude Code setup and OAuth tokens are not API keys and were not used.
4claude-opus-5anthropicclaude-opus-5not probeddisabledT=0, seed=42: temperature and seed are not supported by the Messages API for this model family; not sentunavailableNo ANTHROPIC_API_KEY in the private credential setup (.envrc.local, process environment, ~/.config). Claude Code setup and OAuth tokens are not API keys and were not used.
5claude-sonnet-5anthropicclaude-sonnet-5not probeddisabledT=0, seed=42: temperature and seed are not supported by the Messages API for this model family; not sentunavailableNo ANTHROPIC_API_KEY in the private credential setup (.envrc.local, process environment, ~/.config). Claude Code setup and OAuth tokens are not API keys and were not used.

Noise floor (control arm against itself)

The control arm ran 3 times on identical code. 172 of 250 cases had the same outcome in every repeat; 78 did not. Stable cases by outcome: comparison_unverified 8, correct_completed 17, refusal_unverified 11, silent_wrong 12, task_error 124.

A difference between arms smaller than a metric's spread (max minus min across the control repeats) is not a finding.

metricmeanminmaxspread (noise floor)
first_turn_execution_errors55.6754.0057.003.00
correct_first_turns15.0014.0016.002.00
answer_precision50.81%45.95%54.93%8.98%
silent_wrong34.3331.0040.009.00
correct_completed35.3333.0039.006.00
refusals14.0011.0017.006.00
comparison_unverified13.0010.0015.005.00
full_conversation_successes2.332.003.001.00

Per-arm results

Denominators are fixed: 100 supported first turns, 250 attempts, 50 conversations. Refusals, blocked and comparison-unverified answers earn no completion credit.

Reference only, not an arm: goal-3 original e479e81 (single E5 run, different code; reference only) scored first-turn errors 60/100, correct first turns 14/100, precision 53.7% (36/67), silent wrong 31/250, full conversations 1/50.

0%25%50%75%100%glm-5.2: First-turn errors mean 55.7% (min 54.0%, max 57.0%)56%glm-5.3: First-turn errors mean 59.7% (min 56.0%, max 62.0%)60%First-turn errorsof 100 first turnsglm-5.2: Correct first turns mean 15.0% (min 14.0%, max 16.0%)15%glm-5.3: Correct first turns mean 14.3% (min 13.0%, max 16.0%)14%Correct first turnsof 100 first turnsglm-5.2: Precision mean 50.8% (min 45.9%, max 54.9%)51%glm-5.3: Precision mean 52.8% (min 49.1%, max 55.3%)53%Precisionof answeredglm-5.2: Silent wrong mean 13.7% (min 12.4%, max 16.0%)14%glm-5.3: Silent wrong mean 12.3% (min 11.6%, max 13.6%)12%Silent wrongof 250 attemptsglm-5.2glm-5.3
Headline metrics per arm: bar = mean across repeats, whisker = min to max. First-turn errors and correct first turns are per 100 supported first turns; precision is per answered attempt; silent wrong is per 250 attempts.
Table view
metricglm-5.2 mean [min to max]glm-5.3 mean [min to max]glm-5.3 vs control, paired difference [95% CI]
First-turn execution errors / 10055.7 [54.0 to 57.0]59.7 [56.0 to 62.0]4.0 [-0.7 to 8.3]
Correct first turns / 10015.0 [14.0 to 16.0]14.3 [13.0 to 16.0]-0.7 [-3.3 to 2.3]
Precision = correct / (correct + silent wrong)50.8% [45.9% to 54.9%]52.8% [49.1% to 55.3%]2.3% [-5.1% to 10.3%]
Silent wrong / 25034.3 [31.0 to 40.0]30.7 [29.0 to 34.0]-3.7 [-10.7 to 3.0]
Correct completed / 25035.3 [33.0 to 39.0]34.7 [28.0 to 42.0]not a paired metric
Refusals / 25014.0 [11.0 to 17.0]13.0 [12.0 to 14.0]not a paired metric
Blocked by parent / 2500.0 [0.0 to 0.0]0.0 [0.0 to 0.0]not a paired metric
Comparison unverified / 25013.0 [10.0 to 15.0]12.3 [10.0 to 15.0]not a paired metric
Unnecessary clarification / 2500.0 [0.0 to 0.0]0.0 [0.0 to 0.0]not a paired metric
Full conversation success / 502.3 [2.0 to 3.0]2.7 [2.0 to 4.0]0.3 [-0.7 to 1.7]
Jobs at deadline / 2500.0 [0.0 to 0.0]0.0 [0.0 to 0.0]not a paired metric

First-turn execution errors by cause (per 100 supported first turns)

Causes follow the goal-3 classification of the persisted terminal record and the retained generated SQL. Provider or transport failures are listed separately and are counted.

causeglm-5.2 mean [min to max]glm-5.3 mean [min to max]
Generated SQL lacked schema qualification7.0 [6.0 to 8.0]8.3 [6.0 to 10.0]
Generated schema reference was wrong or absent9.7 [8.0 to 13.0]14.0 [12.0 to 16.0]
Generation returned no usable query0.7 [0.0 to 1.0]1.3 [0.0 to 2.0]
Planner returned no usable source SQL31.0 [28.0 to 35.0]28.7 [27.0 to 31.0]
Required merge key was missing4.7 [3.0 to 7.0]6.0 [4.0 to 7.0]
Terminal boundary needs review1.3 [1.0 to 2.0]1.0 [1.0 to 1.0]
Validation boundary needs review1.3 [1.0 to 2.0]0.3 [0.0 to 1.0]
Total first-turn execution errors55.7 [54.0 to 57.0]59.7 [56.0 to 62.0]

Regressions versus the control (stable cases only)

A case counts as lost only if it was correct in all control repeats and wrong or error in all candidate repeats. Gained cases follow the mirror rule.

armstable correct in controllostcorrect to wrongcorrect to errormixed wrong/errorstable wrong or error in controlgained correct
glm-5.31700001640

Cost and latency per arm

Latency is per SQL-generator provider call, measured inside the isolated server. Live-model latency is advisory: host load and provider responses are not controlled. Cost is list price times the tokens the provider reported, summed over one 250-attempt run; it covers the SQL-generator calls only.

0.0s5.0s10.0s15.0s20.0s25.0sglm-5.2glm-5.2: p5 3075 ms, p25 4187 ms, median 5348 ms, p75 6937 ms, p95 10214 ms, max 21730 ms over 1456 callsp50 5.3s · p95 10.2s · n=1456glm-5.3glm-5.3: p5 3100 ms, p25 4171 ms, median 5340 ms, p75 7069 ms, p95 10728 ms, max 21247 ms over 1471 callsp50 5.3s · p95 10.7s · n=1471seconds per SQL-generator call (all completed calls, all repeats)
Per-call generation latency per arm, all completed calls of all repeats pooled. Box p25 to p75, line = median, whiskers p5 to p95.
0%25%50%75%100%$0.00$1.60$3.20$4.80$6.40$8.00list-price cost of the SQL-generator calls per 250-attempt run (USD)precisionglm-5.2 one repeat: $5.81, precision 54.9%glm-5.2 one repeat: $5.72, precision 45.9%glm-5.2 one repeat: $5.82, precision 51.6%glm-5.2 mean of repeats: $5.79, precision 50.8%glm-5.2glm-5.3 one repeat: $5.84, precision 54.0%glm-5.3 one repeat: $5.88, precision 49.1%glm-5.3 one repeat: $5.83, precision 55.3%glm-5.3 mean of repeats: $5.85, precision 52.8%glm-5.3
Cost per 250-attempt run (list price, SQL-generator calls) against precision. Small dots are single repeats; the large dot is the mean of repeats.
Table view
armcalls per runfailed calls per runp50 msp95 msinput tokens per runoutput tokens per runreasoning tokens per runlist price in/out per 1Mcost per 250 attempts (USD)
glm-5.2485 [476 to 492]0 [0 to 0]5362 [5170 to 5577]10109 [9652 to 10652]3689078 [3665204 to 3701821]141303 [134396 to 145893]59354 [54532 to 62615]$1.40 / $4.405.786 [5.723 to 5.824]
glm-5.3491 [489 to 492]0 [0 to 1]5307 [5088 to 5561]10607 [10130 to 10962]3726734 [3710575 to 3748945]143361 [142287 to 144163]60266 [59411 to 61039]$1.40 / $4.405.848 [5.827 to 5.883]
claude-fable-5-1not run$10.00 / $50.00n/a
claude-opus-5not run$5.00 / $25.00n/a
claude-sonnet-5not run$2.00 / $10.00n/a

Per-family outcome matrix

Each cell is the mean count across repeats of correct / silent wrong / task error attempts in that intent family, out of the family's attempts.

glm-5.2correctwrongerrorglm-5.3correctwrongerroractivity_deadline_before_creationindependent11:activity_deadline_before_creation · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:activity_deadline_before_creation · glm-5.2 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:activity_deadline_before_creation · glm-5.2 · error: 5.00 of 5 attempts (mean across repeats)5.0independent11:activity_deadline_before_creation · glm-5.3 · correct: 1.33 of 5 attempts (mean across repeats)1.3independent11:activity_deadline_before_creation · glm-5.3 · wrong: 0.67 of 5 attempts (mean across repeats)0.7independent11:activity_deadline_before_creation · glm-5.3 · error: 3.00 of 5 attempts (mean across repeats)3.0activity_duration_missing_due_timeindependent11:activity_duration_missing_due_time · glm-5.2 · correct: 2.67 of 5 attempts (mean across repeats)2.7independent11:activity_duration_missing_due_time · glm-5.2 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:activity_duration_missing_due_time · glm-5.2 · error: 2.00 of 5 attempts (mean across repeats)2.0independent11:activity_duration_missing_due_time · glm-5.3 · correct: 2.67 of 5 attempts (mean across repeats)2.7independent11:activity_duration_missing_due_time · glm-5.3 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:activity_duration_missing_due_time · glm-5.3 · error: 2.33 of 5 attempts (mean across repeats)2.3all_commission_unknownindependent11:all_commission_unknown · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:all_commission_unknown · glm-5.2 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:all_commission_unknown · glm-5.2 · error: 4.67 of 5 attempts (mean across repeats)4.7independent11:all_commission_unknown · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:all_commission_unknown · glm-5.3 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:all_commission_unknown · glm-5.3 · error: 5.00 of 5 attempts (mean across repeats)5.0booked_without_settled_historyindependent11:booked_without_settled_history · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:booked_without_settled_history · glm-5.2 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:booked_without_settled_history · glm-5.2 · error: 5.00 of 5 attempts (mean across repeats)5.0independent11:booked_without_settled_history · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:booked_without_settled_history · glm-5.3 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:booked_without_settled_history · glm-5.3 · error: 5.00 of 5 attempts (mean across repeats)5.0campaign_and_web_referralindependent11:campaign_and_web_referral · glm-5.2 · correct: 3.00 of 5 attempts (mean across repeats)3.0independent11:campaign_and_web_referral · glm-5.2 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:campaign_and_web_referral · glm-5.2 · error: 0.00 of 5 attempts (mean across repeats)0.0independent11:campaign_and_web_referral · glm-5.3 · correct: 3.00 of 5 attempts (mean across repeats)3.0independent11:campaign_and_web_referral · glm-5.3 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:campaign_and_web_referral · glm-5.3 · error: 0.00 of 5 attempts (mean across repeats)0.0corporate_registration_without_tradeindependent11:corporate_registration_without_trade · glm-5.2 · correct: 3.00 of 5 attempts (mean across repeats)3.0independent11:corporate_registration_without_trade · glm-5.2 · wrong: 0.67 of 5 attempts (mean across repeats)0.7independent11:corporate_registration_without_trade · glm-5.2 · error: 0.00 of 5 attempts (mean across repeats)0.0independent11:corporate_registration_without_trade · glm-5.3 · correct: 3.00 of 5 attempts (mean across repeats)3.0independent11:corporate_registration_without_trade · glm-5.3 · wrong: 0.67 of 5 attempts (mean across repeats)0.7independent11:corporate_registration_without_trade · glm-5.3 · error: 0.00 of 5 attempts (mean across repeats)0.0customer_referrals_with_reward_eventindependent11:customer_referrals_with_reward_event · glm-5.2 · correct: 5.00 of 5 attempts (mean across repeats)5.0independent11:customer_referrals_with_reward_event · glm-5.2 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:customer_referrals_with_reward_event · glm-5.2 · error: 0.00 of 5 attempts (mean across repeats)0.0independent11:customer_referrals_with_reward_event · glm-5.3 · correct: 5.00 of 5 attempts (mean across repeats)5.0independent11:customer_referrals_with_reward_event · glm-5.3 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:customer_referrals_with_reward_event · glm-5.3 · error: 0.00 of 5 attempts (mean across repeats)0.0deadline_actual_date_disagreementindependent11:deadline_actual_date_disagreement · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:deadline_actual_date_disagreement · glm-5.2 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:deadline_actual_date_disagreement · glm-5.2 · error: 0.00 of 5 attempts (mean across repeats)0.0independent11:deadline_actual_date_disagreement · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:deadline_actual_date_disagreement · glm-5.3 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:deadline_actual_date_disagreement · glm-5.3 · error: 0.00 of 5 attempts (mean across repeats)0.0deal_assignment_overrideindependent11:deal_assignment_override · glm-5.2 · correct: 1.67 of 5 attempts (mean across repeats)1.7independent11:deal_assignment_override · glm-5.2 · wrong: 2.00 of 5 attempts (mean across repeats)2.0independent11:deal_assignment_override · glm-5.2 · error: 0.67 of 5 attempts (mean across repeats)0.7independent11:deal_assignment_override · glm-5.3 · correct: 0.67 of 5 attempts (mean across repeats)0.7independent11:deal_assignment_override · glm-5.3 · wrong: 1.00 of 5 attempts (mean across repeats)1.0independent11:deal_assignment_override · glm-5.3 · error: 3.00 of 5 attempts (mean across repeats)3.0deal_person_organization_conflictindependent11:deal_person_organization_conflict · glm-5.2 · correct: 0.67 of 5 attempts (mean across repeats)0.7independent11:deal_person_organization_conflict · glm-5.2 · wrong: 0.67 of 5 attempts (mean across repeats)0.7independent11:deal_person_organization_conflict · glm-5.2 · error: 3.67 of 5 attempts (mean across repeats)3.7independent11:deal_person_organization_conflict · glm-5.3 · correct: 0.67 of 5 attempts (mean across repeats)0.7independent11:deal_person_organization_conflict · glm-5.3 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:deal_person_organization_conflict · glm-5.3 · error: 4.00 of 5 attempts (mean across repeats)4.0deal_stage_timestamp_orderindependent11:deal_stage_timestamp_order · glm-5.2 · correct: 0.67 of 5 attempts (mean across repeats)0.7independent11:deal_stage_timestamp_order · glm-5.2 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:deal_stage_timestamp_order · glm-5.2 · error: 4.33 of 5 attempts (mean across repeats)4.3independent11:deal_stage_timestamp_order · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:deal_stage_timestamp_order · glm-5.3 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:deal_stage_timestamp_order · glm-5.3 · error: 5.00 of 5 attempts (mean across repeats)5.0deleted_booking_live_accountindependent11:deleted_booking_live_account · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:deleted_booking_live_account · glm-5.2 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:deleted_booking_live_account · glm-5.2 · error: 4.67 of 5 attempts (mean across repeats)4.7independent11:deleted_booking_live_account · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:deleted_booking_live_account · glm-5.3 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:deleted_booking_live_account · glm-5.3 · error: 5.00 of 5 attempts (mean across repeats)5.0different_sales_ownershipindependent11:different_sales_ownership · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:different_sales_ownership · glm-5.2 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:different_sales_ownership · glm-5.2 · error: 5.00 of 5 attempts (mean across repeats)5.0independent11:different_sales_ownership · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:different_sales_ownership · glm-5.3 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:different_sales_ownership · glm-5.3 · error: 4.67 of 5 attempts (mean across repeats)4.7first_booked_before_first_brokerindependent11:first_booked_before_first_broker · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:first_booked_before_first_broker · glm-5.2 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:first_booked_before_first_broker · glm-5.2 · error: 5.00 of 5 attempts (mean across repeats)5.0independent11:first_booked_before_first_broker · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:first_booked_before_first_broker · glm-5.3 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:first_booked_before_first_broker · glm-5.3 · error: 5.00 of 5 attempts (mean across repeats)5.0funnel_incomplete_contactindependent11:funnel_incomplete_contact · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:funnel_incomplete_contact · glm-5.2 · wrong: 4.67 of 5 attempts (mean across repeats)4.7independent11:funnel_incomplete_contact · glm-5.2 · error: 0.00 of 5 attempts (mean across repeats)0.0independent11:funnel_incomplete_contact · glm-5.3 · correct: 0.33 of 5 attempts (mean across repeats)0.3independent11:funnel_incomplete_contact · glm-5.3 · wrong: 4.67 of 5 attempts (mean across repeats)4.7independent11:funnel_incomplete_contact · glm-5.3 · error: 0.00 of 5 attempts (mean across repeats)0.0fx_missing_on_settledindependent11:fx_missing_on_settled · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:fx_missing_on_settled · glm-5.2 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:fx_missing_on_settled · glm-5.2 · error: 4.67 of 5 attempts (mean across repeats)4.7independent11:fx_missing_on_settled · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:fx_missing_on_settled · glm-5.3 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:fx_missing_on_settled · glm-5.3 · error: 4.67 of 5 attempts (mean across repeats)4.7invoice_before_settlementindependent11:invoice_before_settlement · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:invoice_before_settlement · glm-5.2 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:invoice_before_settlement · glm-5.2 · error: 5.00 of 5 attempts (mean across repeats)5.0independent11:invoice_before_settlement · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:invoice_before_settlement · glm-5.3 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:invoice_before_settlement · glm-5.3 · error: 5.00 of 5 attempts (mean across repeats)5.0known_external_person_qualificationindependent11:known_external_person_qualification · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:known_external_person_qualification · glm-5.2 · wrong: 2.67 of 5 attempts (mean across repeats)2.7independent11:known_external_person_qualification · glm-5.2 · error: 2.33 of 5 attempts (mean across repeats)2.3independent11:known_external_person_qualification · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:known_external_person_qualification · glm-5.3 · wrong: 3.33 of 5 attempts (mean across repeats)3.3independent11:known_external_person_qualification · glm-5.3 · error: 1.67 of 5 attempts (mean across repeats)1.7known_zero_booked_commissionindependent11:known_zero_booked_commission · glm-5.2 · correct: 1.67 of 5 attempts (mean across repeats)1.7independent11:known_zero_booked_commission · glm-5.2 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:known_zero_booked_commission · glm-5.2 · error: 0.00 of 5 attempts (mean across repeats)0.0independent11:known_zero_booked_commission · glm-5.3 · correct: 1.33 of 5 attempts (mean across repeats)1.3independent11:known_zero_booked_commission · glm-5.3 · wrong: 1.67 of 5 attempts (mean across repeats)1.7independent11:known_zero_booked_commission · glm-5.3 · error: 0.00 of 5 attempts (mean across repeats)0.0london_signup_month_edgeindependent11:london_signup_month_edge · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:london_signup_month_edge · glm-5.2 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:london_signup_month_edge · glm-5.2 · error: 0.00 of 5 attempts (mean across repeats)0.0independent11:london_signup_month_edge · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:london_signup_month_edge · glm-5.3 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:london_signup_month_edge · glm-5.3 · error: 0.00 of 5 attempts (mean across repeats)0.0marketing_registration_gapindependent11:marketing_registration_gap · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:marketing_registration_gap · glm-5.2 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:marketing_registration_gap · glm-5.2 · error: 3.33 of 5 attempts (mean across repeats)3.3independent11:marketing_registration_gap · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:marketing_registration_gap · glm-5.3 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:marketing_registration_gap · glm-5.3 · error: 4.00 of 5 attempts (mean across repeats)4.0multi_broker_activationindependent11:multi_broker_activation · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:multi_broker_activation · glm-5.2 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:multi_broker_activation · glm-5.2 · error: 5.00 of 5 attempts (mean across repeats)5.0independent11:multi_broker_activation · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:multi_broker_activation · glm-5.3 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:multi_broker_activation · glm-5.3 · error: 5.00 of 5 attempts (mean across repeats)5.0negative_realized_commissionindependent11:negative_realized_commission · glm-5.2 · correct: 1.33 of 5 attempts (mean across repeats)1.3independent11:negative_realized_commission · glm-5.2 · wrong: 0.67 of 5 attempts (mean across repeats)0.7independent11:negative_realized_commission · glm-5.2 · error: 0.33 of 5 attempts (mean across repeats)0.3independent11:negative_realized_commission · glm-5.3 · correct: 1.67 of 5 attempts (mean across repeats)1.7independent11:negative_realized_commission · glm-5.3 · wrong: 0.67 of 5 attempts (mean across repeats)0.7independent11:negative_realized_commission · glm-5.3 · error: 0.00 of 5 attempts (mean across repeats)0.0note_author_deal_owner_differenceindependent11:note_author_deal_owner_difference · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:note_author_deal_owner_difference · glm-5.2 · wrong: 1.00 of 5 attempts (mean across repeats)1.0independent11:note_author_deal_owner_difference · glm-5.2 · error: 4.00 of 5 attempts (mean across repeats)4.0independent11:note_author_deal_owner_difference · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:note_author_deal_owner_difference · glm-5.3 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:note_author_deal_owner_difference · glm-5.3 · error: 4.33 of 5 attempts (mean across repeats)4.3notified_without_verificationindependent11:notified_without_verification · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:notified_without_verification · glm-5.2 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:notified_without_verification · glm-5.2 · error: 5.00 of 5 attempts (mean across repeats)5.0independent11:notified_without_verification · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:notified_without_verification · glm-5.3 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:notified_without_verification · glm-5.3 · error: 5.00 of 5 attempts (mean across repeats)5.0org_contact_without_websiteindependent11:org_contact_without_website · glm-5.2 · correct: 0.67 of 5 attempts (mean across repeats)0.7independent11:org_contact_without_website · glm-5.2 · wrong: 2.00 of 5 attempts (mean across repeats)2.0independent11:org_contact_without_website · glm-5.2 · error: 2.00 of 5 attempts (mean across repeats)2.0independent11:org_contact_without_website · glm-5.3 · correct: 0.67 of 5 attempts (mean across repeats)0.7independent11:org_contact_without_website · glm-5.3 · wrong: 1.67 of 5 attempts (mean across repeats)1.7independent11:org_contact_without_website · glm-5.3 · error: 2.67 of 5 attempts (mean across repeats)2.7organization_client_type_multipleindependent11:organization_client_type_multiple · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:organization_client_type_multiple · glm-5.2 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:organization_client_type_multiple · glm-5.2 · error: 4.33 of 5 attempts (mean across repeats)4.3independent11:organization_client_type_multiple · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:organization_client_type_multiple · glm-5.3 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:organization_client_type_multiple · glm-5.3 · error: 5.00 of 5 attempts (mean across repeats)5.0organization_employee_data_gapindependent11:organization_employee_data_gap · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:organization_employee_data_gap · glm-5.2 · wrong: 0.67 of 5 attempts (mean across repeats)0.7independent11:organization_employee_data_gap · glm-5.2 · error: 4.33 of 5 attempts (mean across repeats)4.3independent11:organization_employee_data_gap · glm-5.3 · correct: 0.33 of 5 attempts (mean across repeats)0.3independent11:organization_employee_data_gap · glm-5.3 · wrong: 1.00 of 5 attempts (mean across repeats)1.0independent11:organization_employee_data_gap · glm-5.3 · error: 3.33 of 5 attempts (mean across repeats)3.3organization_erp_multipleindependent11:organization_erp_multiple · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:organization_erp_multiple · glm-5.2 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:organization_erp_multiple · glm-5.2 · error: 4.67 of 5 attempts (mean across repeats)4.7independent11:organization_erp_multiple · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:organization_erp_multiple · glm-5.3 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:organization_erp_multiple · glm-5.3 · error: 4.67 of 5 attempts (mean across repeats)4.7organization_hedging_multipleindependent11:organization_hedging_multiple · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:organization_hedging_multiple · glm-5.2 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:organization_hedging_multiple · glm-5.2 · error: 5.00 of 5 attempts (mean across repeats)5.0independent11:organization_hedging_multiple · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:organization_hedging_multiple · glm-5.3 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:organization_hedging_multiple · glm-5.3 · error: 5.00 of 5 attempts (mean across repeats)5.0organization_introducer_linkindependent11:organization_introducer_link · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:organization_introducer_link · glm-5.2 · wrong: 0.67 of 5 attempts (mean across repeats)0.7independent11:organization_introducer_link · glm-5.2 · error: 4.00 of 5 attempts (mean across repeats)4.0independent11:organization_introducer_link · glm-5.3 · correct: 0.67 of 5 attempts (mean across repeats)0.7independent11:organization_introducer_link · glm-5.3 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:organization_introducer_link · glm-5.3 · error: 4.33 of 5 attempts (mean across repeats)4.3organization_wallet_share_unknownindependent11:organization_wallet_share_unknown · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:organization_wallet_share_unknown · glm-5.2 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:organization_wallet_share_unknown · glm-5.2 · error: 4.00 of 5 attempts (mean across repeats)4.0independent11:organization_wallet_share_unknown · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:organization_wallet_share_unknown · glm-5.3 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:organization_wallet_share_unknown · glm-5.3 · error: 4.33 of 5 attempts (mean across repeats)4.3outdated_still_activatedindependent11:outdated_still_activated · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:outdated_still_activated · glm-5.2 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:outdated_still_activated · glm-5.2 · error: 5.00 of 5 attempts (mean across repeats)5.0independent11:outdated_still_activated · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:outdated_still_activated · glm-5.3 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:outdated_still_activated · glm-5.3 · error: 4.67 of 5 attempts (mean across repeats)4.7overdue_expected_closeindependent11:overdue_expected_close · glm-5.2 · correct: 1.33 of 5 attempts (mean across repeats)1.3independent11:overdue_expected_close · glm-5.2 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:overdue_expected_close · glm-5.2 · error: 3.67 of 5 attempts (mean across repeats)3.7independent11:overdue_expected_close · glm-5.3 · correct: 1.33 of 5 attempts (mean across repeats)1.3independent11:overdue_expected_close · glm-5.3 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:overdue_expected_close · glm-5.3 · error: 3.33 of 5 attempts (mean across repeats)3.3partner_paid_and_unpaid_statementsindependent11:partner_paid_and_unpaid_statements · glm-5.2 · correct: 1.33 of 5 attempts (mean across repeats)1.3independent11:partner_paid_and_unpaid_statements · glm-5.2 · wrong: 2.33 of 5 attempts (mean across repeats)2.3independent11:partner_paid_and_unpaid_statements · glm-5.2 · error: 0.00 of 5 attempts (mean across repeats)0.0independent11:partner_paid_and_unpaid_statements · glm-5.3 · correct: 2.67 of 5 attempts (mean across repeats)2.7independent11:partner_paid_and_unpaid_statements · glm-5.3 · wrong: 1.00 of 5 attempts (mean across repeats)1.0independent11:partner_paid_and_unpaid_statements · glm-5.3 · error: 0.00 of 5 attempts (mean across repeats)0.0person_communication_preferencesindependent11:person_communication_preferences · glm-5.2 · correct: 2.00 of 5 attempts (mean across repeats)2.0independent11:person_communication_preferences · glm-5.2 · wrong: 0.67 of 5 attempts (mean across repeats)0.7independent11:person_communication_preferences · glm-5.2 · error: 1.67 of 5 attempts (mean across repeats)1.7independent11:person_communication_preferences · glm-5.3 · correct: 1.33 of 5 attempts (mean across repeats)1.3independent11:person_communication_preferences · glm-5.3 · wrong: 1.00 of 5 attempts (mean across repeats)1.0independent11:person_communication_preferences · glm-5.3 · error: 2.00 of 5 attempts (mean across repeats)2.0person_multi_frequency_declarationsindependent11:person_multi_frequency_declarations · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:person_multi_frequency_declarations · glm-5.2 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:person_multi_frequency_declarations · glm-5.2 · error: 4.67 of 5 attempts (mean across repeats)4.7independent11:person_multi_frequency_declarations · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:person_multi_frequency_declarations · glm-5.3 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:person_multi_frequency_declarations · glm-5.3 · error: 5.00 of 5 attempts (mean across repeats)5.0person_note_pinned_exclusivelyindependent11:person_note_pinned_exclusively · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:person_note_pinned_exclusively · glm-5.2 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:person_note_pinned_exclusively · glm-5.2 · error: 4.67 of 5 attempts (mean across repeats)4.7independent11:person_note_pinned_exclusively · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:person_note_pinned_exclusively · glm-5.3 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:person_note_pinned_exclusively · glm-5.3 · error: 5.00 of 5 attempts (mean across repeats)5.0person_organization_owner_gapindependent11:person_organization_owner_gap · glm-5.2 · correct: 0.67 of 5 attempts (mean across repeats)0.7independent11:person_organization_owner_gap · glm-5.2 · wrong: 1.33 of 5 attempts (mean across repeats)1.3independent11:person_organization_owner_gap · glm-5.2 · error: 3.00 of 5 attempts (mean across repeats)3.0independent11:person_organization_owner_gap · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:person_organization_owner_gap · glm-5.3 · wrong: 1.00 of 5 attempts (mean across repeats)1.0independent11:person_organization_owner_gap · glm-5.3 · error: 4.00 of 5 attempts (mean across repeats)4.0prebillable_eligible_statsindependent11:prebillable_eligible_stats · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:prebillable_eligible_stats · glm-5.2 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:prebillable_eligible_stats · glm-5.2 · error: 4.67 of 5 attempts (mean across repeats)4.7independent11:prebillable_eligible_stats · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:prebillable_eligible_stats · glm-5.3 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:prebillable_eligible_stats · glm-5.3 · error: 4.67 of 5 attempts (mean across repeats)4.7private_declared_currency_overlapindependent11:private_declared_currency_overlap · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:private_declared_currency_overlap · glm-5.2 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:private_declared_currency_overlap · glm-5.2 · error: 4.67 of 5 attempts (mean across repeats)4.7independent11:private_declared_currency_overlap · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:private_declared_currency_overlap · glm-5.3 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:private_declared_currency_overlap · glm-5.3 · error: 4.67 of 5 attempts (mean across repeats)4.7professional_zero_rate_referralsindependent11:professional_zero_rate_referrals · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:professional_zero_rate_referrals · glm-5.2 · wrong: 4.67 of 5 attempts (mean across repeats)4.7independent11:professional_zero_rate_referrals · glm-5.2 · error: 0.33 of 5 attempts (mean across repeats)0.3independent11:professional_zero_rate_referrals · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:professional_zero_rate_referrals · glm-5.3 · wrong: 4.00 of 5 attempts (mean across repeats)4.0independent11:professional_zero_rate_referrals · glm-5.3 · error: 1.00 of 5 attempts (mean across repeats)1.0qualified_without_deal_stageindependent11:qualified_without_deal_stage · glm-5.2 · correct: 1.33 of 5 attempts (mean across repeats)1.3independent11:qualified_without_deal_stage · glm-5.2 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:qualified_without_deal_stage · glm-5.2 · error: 3.67 of 5 attempts (mean across repeats)3.7independent11:qualified_without_deal_stage · glm-5.3 · correct: 0.33 of 5 attempts (mean across repeats)0.3independent11:qualified_without_deal_stage · glm-5.3 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:qualified_without_deal_stage · glm-5.3 · error: 4.33 of 5 attempts (mean across repeats)4.3quote_conversion_valid_linkindependent11:quote_conversion_valid_link · glm-5.2 · correct: 0.33 of 5 attempts (mean across repeats)0.3independent11:quote_conversion_valid_link · glm-5.2 · wrong: 1.33 of 5 attempts (mean across repeats)1.3independent11:quote_conversion_valid_link · glm-5.2 · error: 3.33 of 5 attempts (mean across repeats)3.3independent11:quote_conversion_valid_link · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:quote_conversion_valid_link · glm-5.3 · wrong: 2.00 of 5 attempts (mean across repeats)2.0independent11:quote_conversion_valid_link · glm-5.3 · error: 3.00 of 5 attempts (mean across repeats)3.0quote_days_before_activationindependent11:quote_days_before_activation · glm-5.2 · correct: 0.67 of 5 attempts (mean across repeats)0.7independent11:quote_days_before_activation · glm-5.2 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:quote_days_before_activation · glm-5.2 · error: 4.00 of 5 attempts (mean across repeats)4.0independent11:quote_days_before_activation · glm-5.3 · correct: 1.00 of 5 attempts (mean across repeats)1.0independent11:quote_days_before_activation · glm-5.3 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:quote_days_before_activation · glm-5.3 · error: 4.00 of 5 attempts (mean across repeats)4.0quote_only_system_activityindependent11:quote_only_system_activity · glm-5.2 · correct: 1.00 of 5 attempts (mean across repeats)1.0independent11:quote_only_system_activity · glm-5.2 · wrong: 0.67 of 5 attempts (mean across repeats)0.7independent11:quote_only_system_activity · glm-5.2 · error: 3.33 of 5 attempts (mean across repeats)3.3independent11:quote_only_system_activity · glm-5.3 · correct: 0.33 of 5 attempts (mean across repeats)0.3independent11:quote_only_system_activity · glm-5.3 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:quote_only_system_activity · glm-5.3 · error: 3.67 of 5 attempts (mean across repeats)3.7trade_sell_not_declaredindependent11:trade_sell_not_declared · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:trade_sell_not_declared · glm-5.2 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:trade_sell_not_declared · glm-5.2 · error: 5.00 of 5 attempts (mean across repeats)5.0independent11:trade_sell_not_declared · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:trade_sell_not_declared · glm-5.3 · wrong: 0.00 of 5 attempts (mean across repeats)0.0independent11:trade_sell_not_declared · glm-5.3 · error: 5.00 of 5 attempts (mean across repeats)5.0unknown_sti_with_brokerindependent11:unknown_sti_with_broker · glm-5.2 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:unknown_sti_with_broker · glm-5.2 · wrong: 1.33 of 5 attempts (mean across repeats)1.3independent11:unknown_sti_with_broker · glm-5.2 · error: 3.67 of 5 attempts (mean across repeats)3.7independent11:unknown_sti_with_broker · glm-5.3 · correct: 0.00 of 5 attempts (mean across repeats)0.0independent11:unknown_sti_with_broker · glm-5.3 · wrong: 1.00 of 5 attempts (mean across repeats)1.0independent11:unknown_sti_with_broker · glm-5.3 · error: 4.00 of 5 attempts (mean across repeats)4.0verified_after_registrationindependent11:verified_after_registration · glm-5.2 · correct: 4.67 of 5 attempts (mean across repeats)4.7independent11:verified_after_registration · glm-5.2 · wrong: 0.33 of 5 attempts (mean across repeats)0.3independent11:verified_after_registration · glm-5.2 · error: 0.00 of 5 attempts (mean across repeats)0.0independent11:verified_after_registration · glm-5.3 · correct: 4.00 of 5 attempts (mean across repeats)4.0independent11:verified_after_registration · glm-5.3 · wrong: 1.00 of 5 attempts (mean across repeats)1.0independent11:verified_after_registration · glm-5.3 · error: 0.00 of 5 attempts (mean across repeats)0.0verified_private_rejected_registrationindependent11:verified_private_rejected_registration · glm-5.2 · correct: 1.67 of 5 attempts (mean across repeats)1.7independent11:verified_private_rejected_registration · glm-5.2 · wrong: 2.33 of 5 attempts (mean across repeats)2.3independent11:verified_private_rejected_registration · glm-5.2 · error: 0.00 of 5 attempts (mean across repeats)0.0independent11:verified_private_rejected_registration · glm-5.3 · correct: 2.33 of 5 attempts (mean across repeats)2.3independent11:verified_private_rejected_registration · glm-5.3 · wrong: 0.67 of 5 attempts (mean across repeats)0.7independent11:verified_private_rejected_registration · glm-5.3 · error: 0.00 of 5 attempts (mean across repeats)0.0
Per-family mean counts per arm (darker = larger share of the family's attempts). Columns per arm: correct, silent wrong, task error. Denominator: the family's attempts (shown in the tooltip).
Table view
intent familyglm-5.2glm-5.3
activity_deadline_before_creation0.0 / 0.0 / 5.0 of 51.3 / 0.7 / 3.0 of 5
activity_duration_missing_due_time2.7 / 0.3 / 2.0 of 52.7 / 0.0 / 2.3 of 5
all_commission_unknown0.0 / 0.3 / 4.7 of 50.0 / 0.0 / 5.0 of 5
booked_without_settled_history0.0 / 0.0 / 5.0 of 50.0 / 0.0 / 5.0 of 5
campaign_and_web_referral3.0 / 0.0 / 0.0 of 53.0 / 0.3 / 0.0 of 5
corporate_registration_without_trade3.0 / 0.7 / 0.0 of 53.0 / 0.7 / 0.0 of 5
customer_referrals_with_reward_event5.0 / 0.0 / 0.0 of 55.0 / 0.0 / 0.0 of 5
deadline_actual_date_disagreement0.0 / 0.0 / 0.0 of 50.0 / 0.0 / 0.0 of 5
deal_assignment_override1.7 / 2.0 / 0.7 of 50.7 / 1.0 / 3.0 of 5
deal_person_organization_conflict0.7 / 0.7 / 3.7 of 50.7 / 0.3 / 4.0 of 5
deal_stage_timestamp_order0.7 / 0.0 / 4.3 of 50.0 / 0.0 / 5.0 of 5
deleted_booking_live_account0.0 / 0.3 / 4.7 of 50.0 / 0.0 / 5.0 of 5
different_sales_ownership0.0 / 0.0 / 5.0 of 50.0 / 0.3 / 4.7 of 5
first_booked_before_first_broker0.0 / 0.0 / 5.0 of 50.0 / 0.0 / 5.0 of 5
funnel_incomplete_contact0.0 / 4.7 / 0.0 of 50.3 / 4.7 / 0.0 of 5
fx_missing_on_settled0.0 / 0.3 / 4.7 of 50.0 / 0.3 / 4.7 of 5
invoice_before_settlement0.0 / 0.0 / 5.0 of 50.0 / 0.0 / 5.0 of 5
known_external_person_qualification0.0 / 2.7 / 2.3 of 50.0 / 3.3 / 1.7 of 5
known_zero_booked_commission1.7 / 0.3 / 0.0 of 51.3 / 1.7 / 0.0 of 5
london_signup_month_edge0.0 / 0.0 / 0.0 of 50.0 / 0.0 / 0.0 of 5
marketing_registration_gap0.0 / 0.3 / 3.3 of 50.0 / 0.0 / 4.0 of 5
multi_broker_activation0.0 / 0.0 / 5.0 of 50.0 / 0.0 / 5.0 of 5
negative_realized_commission1.3 / 0.7 / 0.3 of 51.7 / 0.7 / 0.0 of 5
note_author_deal_owner_difference0.0 / 1.0 / 4.0 of 50.0 / 0.3 / 4.3 of 5
notified_without_verification0.0 / 0.0 / 5.0 of 50.0 / 0.0 / 5.0 of 5
org_contact_without_website0.7 / 2.0 / 2.0 of 50.7 / 1.7 / 2.7 of 5
organization_client_type_multiple0.0 / 0.0 / 4.3 of 50.0 / 0.0 / 5.0 of 5
organization_employee_data_gap0.0 / 0.7 / 4.3 of 50.3 / 1.0 / 3.3 of 5
organization_erp_multiple0.0 / 0.0 / 4.7 of 50.0 / 0.3 / 4.7 of 5
organization_hedging_multiple0.0 / 0.0 / 5.0 of 50.0 / 0.0 / 5.0 of 5
organization_introducer_link0.0 / 0.7 / 4.0 of 50.7 / 0.0 / 4.3 of 5
organization_wallet_share_unknown0.0 / 0.3 / 4.0 of 50.0 / 0.0 / 4.3 of 5
outdated_still_activated0.0 / 0.0 / 5.0 of 50.0 / 0.3 / 4.7 of 5
overdue_expected_close1.3 / 0.0 / 3.7 of 51.3 / 0.3 / 3.3 of 5
partner_paid_and_unpaid_statements1.3 / 2.3 / 0.0 of 52.7 / 1.0 / 0.0 of 5
person_communication_preferences2.0 / 0.7 / 1.7 of 51.3 / 1.0 / 2.0 of 5
person_multi_frequency_declarations0.0 / 0.3 / 4.7 of 50.0 / 0.0 / 5.0 of 5
person_note_pinned_exclusively0.0 / 0.0 / 4.7 of 50.0 / 0.0 / 5.0 of 5
person_organization_owner_gap0.7 / 1.3 / 3.0 of 50.0 / 1.0 / 4.0 of 5
prebillable_eligible_stats0.0 / 0.3 / 4.7 of 50.0 / 0.3 / 4.7 of 5
private_declared_currency_overlap0.0 / 0.3 / 4.7 of 50.0 / 0.3 / 4.7 of 5
professional_zero_rate_referrals0.0 / 4.7 / 0.3 of 50.0 / 4.0 / 1.0 of 5
qualified_without_deal_stage1.3 / 0.0 / 3.7 of 50.3 / 0.0 / 4.3 of 5
quote_conversion_valid_link0.3 / 1.3 / 3.3 of 50.0 / 2.0 / 3.0 of 5
quote_days_before_activation0.7 / 0.3 / 4.0 of 51.0 / 0.0 / 4.0 of 5
quote_only_system_activity1.0 / 0.7 / 3.3 of 50.3 / 0.3 / 3.7 of 5
trade_sell_not_declared0.0 / 0.0 / 5.0 of 50.0 / 0.0 / 5.0 of 5
unknown_sti_with_broker0.0 / 1.3 / 3.7 of 50.0 / 1.0 / 4.0 of 5
verified_after_registration4.7 / 0.3 / 0.0 of 54.0 / 1.0 / 0.0 of 5
verified_private_rejected_registration1.7 / 2.3 / 0.0 of 52.3 / 0.7 / 0.0 of 5

Method

Unverified

Evidence