Quickstart

​

Prerequisites

1. An Autoblocks account
2. OpenAI API key (for evaluators)
3. Basic understanding of your agent’s API endpoint

​

Create Your First Simulation

​

1. Create a New Scenario

• Navigate to “Simulations” in the sidebar
• Click “New Scenario”
• Name your scenario (e.g., “Appointment Confirmation”)
• Add a clear description of what you’re testing

​

2. Configure Personas

• Click “Add Persona”
• Choose from pre-built options:
  • Elderly Caller
  • Impatient Caller
  • Distracted Caller
• Start with one persona for your first test

​

3. Set Up Data Fields

• Add fields your agent needs to collect
• For each field:
  • Provide a clear name
  • Add 2-3 common variants
  • Example for dates:
    • “March 15, 2023”
    • “3/15/23”
    • “next Wednesday”

​

4. Add Edge Cases

• Select relevant edge cases:
  • Interruptions
  • Background noise
  • Unclear responses
• Start with 1-2 edge cases for initial testing

​

5. Run Your Simulation

• Review your configuration
• Click “Test Scenario”
• Enter required information:
  • Phone number to call
  • Description of the test run
• Click “Run Simulation”

​

Review Results

​

1. Check Execution

• View the conversation transcript
• Listen to the audio recording
• Review success/failure status

​

2. Analyze Performance

• Check if data was captured correctly
• Review any evaluation feedback
• Note areas for improvement

​

Next Steps

1. Iterate and Improve
   • Add more personas
   • Include additional edge cases
   • Refine evaluation criteria
2. Scale Testing
   • Create variations of your scenario
   • Test different conversation flows
   • Add more complex edge cases
3. Monitor and Optimize
   • Track success rates
   • Review usage in Settings
   • Optimize based on results