OpenWriterControle/evals/agents/openagent/tests/developer
darrenhinde e43eaff317 feat(evals): add BehaviorEvaluator and improve test validation
- Add BehaviorEvaluator for validating agent behavior expectations:
  - mustUseTools/mustNotUseTools validation
  - minToolCalls/maxToolCalls validation
  - requiresApproval/requiresContext/shouldDelegate checks

- Fix test schema to allow behavior alone (without expectedViolations)
- Add 41 unit tests for BehaviorEvaluator, TestCaseSchema, and YAML loading
- Improve test-runner event logging with meaningful tool/message details
- Fix glob import for ESM compatibility
- Add new test cases for bash, context loading, and approval scenarios
2025-11-26 01:10:51 +00:00
..
create-component.yaml feat: add 5 essential workflow tests and reorganize with agents/ structure 2025-11-22 15:20:59 +00:00
ctx-code-001.yaml feat: add 5 essential workflow tests and reorganize with agents/ structure 2025-11-22 15:20:59 +00:00
ctx-delegation-001.yaml feat(evals): add BehaviorEvaluator and improve test validation 2025-11-26 01:10:51 +00:00
ctx-docs-001.yaml feat: add 5 essential workflow tests and reorganize with agents/ structure 2025-11-22 15:20:59 +00:00
fail-stop-001.yaml feat: add 5 essential workflow tests and reorganize with agents/ structure 2025-11-22 15:20:59 +00:00
install-dependencies-v2.yaml feat: add 5 essential workflow tests and reorganize with agents/ structure 2025-11-22 15:20:59 +00:00
install-dependencies.yaml feat: add 5 essential workflow tests and reorganize with agents/ structure 2025-11-22 15:20:59 +00:00
simple-bash-test.yaml feat(evals): add BehaviorEvaluator and improve test validation 2025-11-26 01:10:51 +00:00
task-simple-001.yaml feat: add 5 essential workflow tests and reorganize with agents/ structure 2025-11-22 15:20:59 +00:00