cclohmar/OpenWriterControle
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
OpenWriterControle/evals/test_tmp
History
darrenhinde f773b290ce chore(evals): comprehensive cleanup, documentation, and test infrastructure improvements 
Documentation:
- Add ARCHITECTURE.md with comprehensive system review
- Add GETTING_STARTED.md for new users
- Add DOCUMENTATION_CLEANUP.md tracking cleanup changes
- Add SCRIPTS_ORGANIZATION.md documenting script reorganization
- Remove outdated docs (TESTING_CONFIDENCE.md, TEST_REVIEW.md, SESSION_STORAGE_FIX.md)
- Update README files with current information

Script Organization:
- Move 12 scripts from framework root to organized directories:
  - scripts/debug/ (4 files): Session debugging tools
  - scripts/test/ (6 files): Test execution scripts
  - scripts/utils/ (2 files): Utility scripts
- Add comprehensive scripts/README.md with usage examples

Test Infrastructure:
- Add 5 new context loading tests for openagent
- Add result-saver.ts for test result persistence
- Add interactive results dashboard (index.html)
- Add error-handling.test.ts for framework testing
- Add result-saver.test.ts with comprehensive unit tests

Evaluator Improvements:
- Enhance context-loading-evaluator with better detection
- Update run-sdk-tests.ts with improved result handling

Agent Configuration:
- Add .opencode/agent/AGENT.md for agent definition

Test Utilities:
- Add test-agent-manual.mjs for manual testing
- Update test_tmp/README.md with usage guidelines

This commit consolidates multiple improvements:
- Better organization (scripts, docs)
- Improved testing infrastructure
- Comprehensive documentation
- Cleaner codebase structure
2025-11-26 21:34:27 +00:00
..
.gitignore fix(evals): use test_tmp directory for test artifacts and add cleanup 2025-11-26 10:14:29 +00:00
README.md chore(evals): comprehensive cleanup, documentation, and test infrastructure improvements 2025-11-26 21:34:27 +00:00

README.md

Test Artifacts

This directory contains temporary files created during test execution. It should be cleaned up after tests complete.

DO NOT COMMIT FILES IN THIS DIRECTORY

Installation

To install the project dependencies, navigate to the evaluation framework directory and run:

cd evals/framework
npm install

This will install all required dependencies including:

  • @opencode-ai/sdk - OpenCode AI SDK
  • yaml - YAML parser for test cases
  • zod - Schema validation
  • glob - File pattern matching

Development Dependencies

For development and testing, the following tools are also installed:

  • TypeScript compiler
  • Vitest testing framework
  • ESLint for code linting
  • tsx for TypeScript execution