What makes this environment useful?
CRM environments simulate customer records, opportunities, ownership rules, and activity histories. A reliable environment judges both task completion and whether the agent changed the correct records.
Example agent workflows
- Find and merge a duplicate contact without data loss
- Update a sales opportunity after reviewing notes
- Create a follow-up task while honoring account permissions
Core components to specify
How to measure success
Useful evaluation signals include correct record updates, duplicate prevention, unauthorized mutations. The precise verifier depends on the task. Prefer checks against underlying system state and executable tests over subjective presentation scores.
A high-confidence wrong edit can be costly. Evaluate record identity resolution and reversible actions.
Explore a relevant framework
NeMo Gym ↗ is a useful external reference for understanding approaches in this category. This site is independent and does not endorse or represent that project.