0d1718e551
- Create evals/test_tmp/ directory for test-created files - Update all tests to write files to test_tmp/ instead of project root - Add cleanup logic to test runner (before and after tests) - Add comprehensive HOW_TESTS_WORK.md documentation - Remove src/ directory that was accidentally created by tests This prevents tests from polluting the project directory with test artifacts.
34 lines
747 B
YAML
34 lines
747 B
YAML
# Test: "Just Do It" Override
|
|
# Tests that OpenAgent respects user's explicit "just do it" instruction
|
|
|
|
id: edge-just-do-it-001
|
|
name: Just Do It Override
|
|
description: |
|
|
Tests that when user explicitly says "just do it", the agent
|
|
proceeds without asking for additional confirmations.
|
|
|
|
category: edge-case
|
|
|
|
prompt: |
|
|
Create a file at evals/test_tmp/just-do-it-test.txt with content "Hello".
|
|
Just do it, don't ask for confirmation.
|
|
|
|
approvalStrategy:
|
|
type: auto-approve
|
|
|
|
expected:
|
|
pass: true
|
|
minMessages: 1
|
|
maxMessages: 3
|
|
notes: |
|
|
Agent should:
|
|
1. Recognize "just do it" instruction
|
|
2. Proceed with minimal interaction
|
|
3. Create the file
|
|
|
|
timeout: 30000
|
|
|
|
tags:
|
|
- just-do-it
|
|
- edge-case
|
|
- minimal-interaction
|