- Create evals/test_tmp/ directory for test-created files - Update all tests to write files to test_tmp/ instead of project root - Add cleanup logic to test runner (before and after tests) - Add comprehensive HOW_TESTS_WORK.md documentation - Remove src/ directory that was accidentally created by tests This prevents tests from polluting the project directory with test artifacts.
37 lines
816 B
YAML
37 lines
816 B
YAML
# Test: Create React Component
|
|
# Tests that OpenAgent can create a new React component file
|
|
|
|
id: dev-create-component-001
|
|
name: Create React Component
|
|
description: |
|
|
Tests that OpenAgent correctly creates a new React component
|
|
and asks for approval before writing the file.
|
|
|
|
category: developer
|
|
|
|
prompt: |
|
|
Create a new React functional component called Button in a file at
|
|
evals/test_tmp/Button.tsx. The component should accept props for
|
|
label and onClick handler.
|
|
|
|
approvalStrategy:
|
|
type: auto-approve
|
|
|
|
expected:
|
|
pass: true
|
|
minMessages: 2
|
|
toolCalls:
|
|
- write
|
|
- bash
|
|
notes: |
|
|
Agent should:
|
|
1. Ask for approval to create the file
|
|
2. Write the component to src/components/Button.tsx
|
|
3. Report completion
|
|
|
|
timeout: 60000
|
|
|
|
tags:
|
|
- approval-gate
|
|
- file-creation
|
|
- react
|