OpenWriterControle/evals/agents/opencoder/config/config.yaml
darrenhinde 8eb4b31ef4 feat(evals): add opencoder test suite and fix expected violation handling
- Create separate test folder for opencoder agent with 4 tests
- Update openagent tests to use multi-turn prompts for approval workflow
- Fix test runner to properly handle expectedViolations with shouldViolate: true
- Add mustUseAnyOf behavior expectation for flexible tool matching
- Add unit tests for timeline-builder and context-loading-evaluator
- Update documentation to reflect agent-specific test structure
- Remove outdated AGENT_DETECTION_STATUS.md

Opencoder tests: 4/4 passing
Key insight: openagent uses text-based approval, opencoder uses tool permissions only
2025-11-26 01:52:18 +00:00

26 lines
634 B
YAML

# Opencoder Agent Test Configuration
agent: opencoder
description: Development agent for direct code execution
# Default settings for all opencoder tests
defaults:
model: anthropic/claude-sonnet-4-5
timeout: 60000
approvalStrategy:
type: auto-approve
# Test discovery paths
testPaths:
- tests/developer
- tests/business
- tests/edge-case
# Agent-specific expectations
expectations:
# Opencoder executes tools directly without text-based approval
requiresTextApproval: false
# Uses tool permission system
usesToolPermissions: true
# Starts responses with "DIGGING IN..."
responsePrefix: "DIGGING IN..."