Skip to content

Latest commit

 

History

History
37 lines (34 loc) · 7.96 KB

File metadata and controls

37 lines (34 loc) · 7.96 KB

Data Board

Languages: English | Chinese

This board summarizes the released GDPevo task groups: 240 tasks across 24 stateful benchmark units. Each task group has one shared business environment, five train tasks, and five held-out test tasks, allowing the benchmark to measure whether agent evolution from earlier tasks improves later work in the same environment. Full definitions are available in each task group's task_group.yaml.

task_group_id scenario_id domain focus train test path
task_group_001 SCN_001_crm_marketing_lead_capture CRM Front-of-funnel CRM marketing tasks covering event sponsorship, trade-show prospecting, and contact-import hygiene. 5 5 task_group_001
task_group_002 SCN_002_crm_b2b_quote_account_response CRM B2B quote/account response tasks covering RFQs, catalogs, freight quotes, invoices, payments, and account follow-up. 5 5 task_group_002
task_group_003 SCN_003_crm_service_ticket_resolution CRM CRM service operations tasks covering offline ticket resolution, mobile support triage, and enterprise complaint investigation. 5 5 task_group_003
task_group_004 SCN_004_crm_retention_churn_analytics CRM CRM retention and churn analytics tasks covering renewal risk, QBR metrics, receivables follow-up, and churn validation. 5 5 task_group_004
task_group_005 SCN_005_erp_finance_expense_control ERP ERP finance expense control and accounting close tasks covering reimbursement claims, AP bills/payments, vendor compliance, prepaid schedules, GL balances, and close logs. 5 5 task_group_005
task_group_006 SCN_006_erp_procurement_supplier_receiving ERP ERP procurement supplier and receiving control tasks covering sourcing gates, purchase orders, receiving controls, AP invoice release, payments, approvals, budgets, and vendor risk. 5 5 task_group_006
task_group_007 SCN_007_erp_inventory_order_fulfillment ERP ERP inventory, order fulfillment, replenishment, and warehouse incident tasks in a shared Northwind Components office environment. 5 5 task_group_007
task_group_008 SCN_008_personal_financial_advisory_tax_estate_planning Finance Private wealth advisory tasks covering Roth conversion, ILIT Crummey administration, GRAT/CRAT comparison, and estate-liquidity planning. 5 5 task_group_008
task_group_009 SCN_009_finance_operational_modeling_management_reporting Finance Finance operations modeling tasks covering branch reporting, CBA compensation forecasting, and theatre weekly payroll control calculations. 5 5 task_group_009
task_group_010 SCN_010_institutional_investment_strategy_portfolio_risk Finance Institutional investment strategy tasks covering energy and fixed-income trade strategy, international correlation review, and cross-asset active allocation view updates. 5 5 task_group_010
task_group_011 SCN_011_bank_branch_credit_risk_lending_committee Finance Branch credit-risk and lending-committee tasks covering loan portfolio reviews, risk ratings, benchmarks, application queues, concentration limits, stress tests, and controls. 5 5 task_group_011
task_group_012 SCN_012_erp_hr_employee_lifecycle ERP Web-first ERP HR lifecycle and PeopleOps tasks covering employee records, recruitment, leave, payroll, policy cases, documents, messages, and audit operations. 5 5 task_group_012
task_group_013 SCN_013_healthcare_patient_intake_transfer Healthcare Operations Healthcare intake coordination tasks covering patient coverage, pharmacy, referral, transfer, document, chart, ICD, chronic-care program, registration, scheduling, enrollment, and chart-activation decisions. 5 5 task_group_013
task_group_014 SCN_014_healthcare_payer_authorization_appeals Healthcare Revenue Cycle Healthcare payer operations tasks covering prior authorization, appeals, peer-to-peer review, payment integrity, claims, reimbursement, and mixed-queue triage. 5 5 task_group_014
task_group_015 SCN_015_healthcare_ehr_quality_governance Healthcare Data Operations EHR data governance and clinical record quality-control tasks covering duplicate charts, referral readiness, service requests, care-transition packets, ICD/code quality, and follow-up queues. 5 5 task_group_015
task_group_016 SCN_016_healthcare_clinical_protocol_decision_support Healthcare Clinical Decision Support Protocol-bound clinical decision-support tasks covering acute visit assessment, lab and medication decisions, FHIR-like observation retrieval, and high-risk care-management routing. 5 5 task_group_016
task_group_017 SCN_017_white_collar_investigation_production_review Legal White-collar investigation production-review tasks covering subpoena categories, custodian collections, retention and preservation events, privilege and QC records, and remediation actions. 5 5 task_group_017
task_group_018 SCN_018_court_clerk_disposition_orders_and_financial_entries Legal Court-clerk operations tasks covering dispositions, orders, financial entries, probation referrals, license suspensions, and payment plans across case, citation, fee, form, docket, and policy records. 5 5 task_group_018
task_group_019 SCN_019_regulatory_licensing_eligibility_and_compliance_review Legal Administrative licensing tasks covering contractor eligibility, restricted liquor-license applications, alcohol-license renewals, policy compliance, and manual-review queues. 5 5 task_group_019
task_group_020 SCN_020_ma_transaction_contract_review_and_negotiation Legal Corporate M&A transaction-counsel tasks covering contract deviations, issue registers, closing packages, committee escalation, risk analysis, and negotiation positions. 5 5 task_group_020
task_group_021 SCN_021_data_cleaning_quality_pipeline Data Analysis Asteria Fleet data-quality certification tasks covering contact canonicalization, fuel and freight normalization, maintenance-event integrity, provenance, quarantine, and operational release decisions across noisy overlapping sources. 5 5 task_group_021
task_group_022 SCN_022_sql_database_analytics Commerce Operations SQL Analytics and Data Reconciliation Authenticated SQLite commerce-operations tasks covering cutoff-consistent fulfillment, refunds, support, warehouse productivity, inventory analytics, data reconciliation, and controlled corrections. 5 5 task_group_022
task_group_023 SCN_023_public_health_statistical_modeling_audit Public Health Statistical Modeling and Data Audit Publication-grade public-health audit tasks covering release and identifier reconciliation, cohort construction, state/county/country statistical modeling, robustness, transportability, and controlled conclusions. 5 5 task_group_023
task_group_024 SCN_024_engineering_portfolio_work_item_analytics Engineering Operations Data Analysis Engineering portfolio analytics tasks covering work-mix classification, delivery gaps, reliability and security SLA aging, release readiness, blockers, and dependency rollups. 5 5 task_group_024