What makes this environment useful?

CRM environments simulate customer records, opportunities, ownership rules, and activity histories. A reliable environment judges both task completion and whether the agent changed the correct records.

Example agent workflows

  • Find and merge a duplicate contact without data loss
  • Update a sales opportunity after reviewing notes
  • Create a follow-up task while honoring account permissions

Core components to specify

Synthetic account/contact/opportunity graphs
Permission-aware CRM tool interfaces
Before/after database assertions and audit logs

How to measure success

Useful evaluation signals include correct record updates, duplicate prevention, unauthorized mutations. The precise verifier depends on the task. Prefer checks against underlying system state and executable tests over subjective presentation scores.

DESIGN WATCH-OUT

A high-confidence wrong edit can be costly. Evaluate record identity resolution and reversible actions.

Explore a relevant framework

NeMo Gym ↗ is a useful external reference for understanding approaches in this category. This site is independent and does not endorse or represent that project.

CRM RL environmentsSalesforce agent training environmentCRM agent evaluation