* chore: update package-lock.json after npm install * chore: remove unused ajv-cli, keep vitest at stable 1.6.1 - Removed ajv-cli (unused dev dependency, had high severity vulnerability) - Kept vitest at 1.6.1 (stable, upgrading to v4 requires extensive refactoring) - Reduced vulnerabilities from 6 to 4 (all moderate, dev-only) - All remaining vulnerabilities are in esbuild/vite (dev server only, no production impact) - Build and tests verified working * feat(evals): add execution-balance validation to 21 OpenAgent tests and enhance agent system Major improvements to evaluation framework and agent capabilities: ## Execution Balance Evaluator Integration - Added execution-balance rule to 21 OpenAgent tests (2.7% → 31.5% coverage) - Validates "read before execute" pattern across critical rules, workflows, and edge cases - Tests now check: read operations before execution tools, healthy read/exec ratio (≥1.0) - Coverage includes: approval-gate, context-loading, stop-on-failure, report-first tests ## Agent System Enhancements - Enhanced OpenCoder agent with critical rules enforcement (approval gates, context loading) - Added structured delegation rules and workflow phases - Improved error handling with REPORT→PROPOSE→REQUEST→FIX pattern ## New Agent Creation System - Added research-backed agent creation templates and guides - Includes 8 test templates covering planning, context, incremental execution, tools - Automated agent scaffolding with /create-agent command - Complete documentation in .opencode/command/openagents/new-agents/ ## OpenCoder Test Suite - Added 8 comprehensive test cases for OpenCoder agent - Tests cover: planning, context-loading, delegation, error-handling, implementation - Includes DEBUG_GUIDE.md and QUICK_TEST_GUIDE.md for developers ## Documentation & Tooling - Added DEVELOPMENT.md guide for contributors - Enhanced CONTRIBUTING.md with quick reference and common commands - Improved event-logger with DEBUG_VERBOSE mode for detailed output - Added debug scripts: show-test-conversation.sh, run-test-verbose.sh - Removed deprecated EXTERNAL_PR_GUIDE.md ## Version Bump - Bumped version to 0.0.3 (patch) Files changed: 60+ files (21 test updates, 16 new agent templates, 8 new tests, docs, tooling) * feat(ci): add PR title validation for semantic versioning Add automated PR title validation to ensure conventional commit format. This enables proper automatic version bumping when PRs are merged. Features: - Validates PR titles against conventional commit patterns - Shows expected version bump (major/minor/patch) - Posts helpful comment with examples if validation fails - Supports all conventional commit types (feat, fix, docs, etc.) - Supports breaking changes (feat!, fix!) - Supports pre-release tags ([alpha], [beta], [rc]) When PR titles follow the format, version bumping works correctly: - feat: → minor bump (0.3.0 → 0.4.0) - fix: → patch bump (0.3.0 → 0.3.1) - feat!: → major bump (0.3.0 → 1.0.0) * fix(ci): improve PR checks workflow with sequential execution Reorganize PR checks to run in logical sequence and skip unnecessary checks: Changes: - Run PR title validation first (fast, always required) - Detect changed files to determine which checks to run - Only run build checks if evals/ files changed - Add comprehensive summary job showing all check results - Prevent cache errors when evals files not changed Benefits: - Faster PR checks (skip unnecessary builds) - Clear sequential execution (title → changes → build) - Better error messages and summaries - Reduced CI/CD costs * fix(ci): resolve PR #42 issues and refactor prompt architecture ## Fixed PR #42 Issues 1. **Prompt Validation** - Refactored to new architecture where agent files are canonical defaults 2. **Package-lock.json** - Fixed workflow to use root package-lock (npm workspaces) 3. **Git Merge Base** - Added fetch-depth: 0 to PR checks workflow ## New Prompt Architecture **Before:** - Agent files had to match .opencode/prompts/<agent>/default.md - Caused validation failures when updating prompts - Redundant duplication **After:** - Agent files (.opencode/agent/*.md) = Canonical defaults (source of truth) - Prompt variants (.opencode/prompts/<agent>/<model>.md) = Model-specific optimizations - No more default.md files needed ## Changes ### Workflows - pr-checks.yml: Added fetch-depth: 0 for full git history - validate-test-suites.yml: Fixed package-lock path for npm workspaces - validate-registry.yml: Updated validation messaging ### Scripts - validate-pr.sh: Validates prompt library structure (rejects default.md files) - use-prompt.sh: Handles 'default' as agent file, variants as model-specific - test-prompt.sh: Tests default variant correctly, saves results to prompts/results/ ### Documentation - .opencode/prompts/README.md: Updated architecture explanation - docs/contributing/CONTRIBUTING.md: Updated prompt workflow - scripts/development/demo.sh: Updated structure display ## Results - 12 files changed, 231 insertions(+), 811 deletions(-) - Net reduction: 580 lines (cleaner codebase) - All validations passing - Results directory structure preserved - Backwards compatible with existing test results
11 KiB
Contributing to OpenAgents
Thank you for your interest in contributing! This guide will help you add new components to the registry and understand the repository structure.
📚 Documentation
- Development Guide - Complete guide for developing on this repo (agents, commands, tools, testing)
- Agent Creation System - ⭐ NEW: Research-backed agent creation with templates
- Code of Conduct - Community guidelines
- Adding Evaluators - How to add new test evaluators
Repository Structure
opencode-agents/
├── .opencode/
│ ├── agent/ # Agents
│ │ ├── openagent.md # Main orchestrator (always default in PRs)
│ │ ├── opencoder.md # Development specialist
│ │ └── subagents/ # Specialized subagents
│ ├── prompts/ # Prompt library (variants and experiments)
│ ├── command/ # Slash commands
│ ├── tool/ # Utility tools
│ ├── plugin/ # Integrations
│ └── context/ # Context files
├── evals/
│ ├── agents/ # Agent test suites
│ ├── framework/ # Testing framework
│ └── results/ # Test results
├── scripts/
│ ├── prompts/ # Prompt management
│ └── tests/ # Test utilities
└── docs/
├── agents/ # Agent documentation
├── contributing/ # Contribution guides
└── guides/ # User guides
Key Directories
.opencode/agent/- Main agent prompts (openagent.md, opencoder.md).opencode/agent/subagents/- Specialized subagents.opencode/prompts/- Library of prompt variants for different modelsevals/- Testing framework and test suitesscripts/- Automation and utility scriptsdocs/- Documentation and guides
Quick Start
- Fork the repository
- Create a new branch for your feature
- Add your component
- Test it works
- Submit a pull request
Adding New Components
Component Types
- Agents (
.opencode/agent/*.md) - Main AI agents - Subagents (
.opencode/agent/subagents/*.md) - Specialized helpers - Commands (
.opencode/command/*.md) - Slash commands - Tools (
.opencode/tool/*/index.ts) - Utility tools - Plugins (
.opencode/plugin/*.ts) - Integrations - Contexts (
.opencode/context/**/*.md) - Context files
Component Structure
For Markdown Files (Agents, Commands, Contexts)
All markdown files should include YAML frontmatter:
---
description: "Brief description of what this does"
mode: primary # For agents only
temperature: 0.1 # Optional - for agents only
tools: # For agents only
read: true
edit: true
write: true
permissions: # Optional
bash:
"*": "deny"
---
# Component Name
Your component content here...
Required fields:
description- Brief description (all components)
Agent-specific fields:
mode- Agent mode (primary, secondary, etc.)model- AI model to usetemperature- Temperature settingtools- Available toolspermissions- Security permissions
For TypeScript Files (Tools, Plugins)
Include JSDoc comments at the top:
/**
* Tool Name
*
* Brief description of what this tool does
*/
export function myTool() {
// Implementation
}
File Naming Conventions
- kebab-case for file names:
my-new-agent.md - PascalCase for TypeScript types/interfaces
- camelCase for variables and functions
Adding Your Component
-
Create the component file in the appropriate directory:
# Example: Adding a new agent touch .opencode/agent/my-new-agent.md -
Add frontmatter and content following the structure above
-
Test your component:
# Validate structure ./scripts/registry/validate-component.sh -
Update the registry (automatic on merge to main):
# Manual update (optional) ./scripts/registry/register-component.sh
Component Categories
When adding components, they're automatically categorized:
- core - Essential components included in minimal installs
- extended - Additional features for developer profile
- advanced - Experimental or specialized components
The auto-registration script assigns categories based on component type and location.
Testing Your Component
Local Testing
-
Install locally:
# Test the installer ./install.sh --list -
Validate structure:
./scripts/registry/validate-component.sh -
Test with OpenCode:
opencode --agent your-new-agent
Automated Testing
When you submit a PR, GitHub Actions will:
- Validate component structure
- Validate prompts use defaults
- Update the registry
- Run validation checks
Important: PRs will fail if agents don't use their default prompts. This ensures the main branch stays stable.
Prompt Library System
OpenCode uses a model-specific prompt library to support different AI models while keeping the main branch stable.
How It Works
.opencode/
├── agent/ # Active prompts (always default in PRs)
│ ├── openagent.md
│ └── opencoder.md
└── prompts/ # Prompt library (model-specific variants)
├── openagent/
│ ├── gpt.md # GPT-4 optimized
│ ├── gemini.md # Gemini optimized
│ ├── grok.md # Grok optimized
│ ├── llama.md # Llama/OSS optimized
│ ├── TEMPLATE.md # Template for new variants
│ ├── README.md # Capabilities table
│ └── results/ # Test results (all variants)
└── opencoder/
└── ...
**Architecture:**
- Agent files (`.opencode/agent/*.md`) = Canonical defaults
- Prompt variants (`.opencode/prompts/<agent>/<model>.md`) = Model-specific optimizations
For Contributors
Testing a Prompt Variant
# Test a specific variant
./scripts/prompts/test-prompt.sh openagent sonnet-4
# View results
cat .opencode/prompts/openagent/results/sonnet-4-results.json
Creating a New Variant
-
Copy the template:
cp .opencode/prompts/openagent/TEMPLATE.md .opencode/prompts/openagent/my-variant.md -
Edit your variant:
- Add variant info (target model, focus, author)
- Document changes from default
- Write your prompt
-
Test it:
./scripts/prompts/test-prompt.sh openagent my-variant -
Update the README:
- Add your variant to the capabilities table in
.opencode/prompts/openagent/README.md - Document test results
- Explain what it optimizes for
- Add your variant to the capabilities table in
-
Submit PR:
- Include your variant file (e.g.,
my-variant.md) - Include updated README with results
- Do NOT change the default prompt
- Do NOT change
.opencode/agent/openagent.md
- Include your variant file (e.g.,
PR Requirements for Prompts
All PRs must use default prompts. CI automatically validates this.
Before submitting a PR:
# Ensure you're using defaults
./scripts/prompts/validate-pr.sh
# If validation fails, restore defaults
./scripts/prompts/use-prompt.sh openagent default
./scripts/prompts/use-prompt.sh opencoder default
Why This System?
- Stability: Main branch always uses tested defaults
- Experimentation: Contributors can optimize for specific models
- Transparency: Test results are documented for each variant
- Flexibility: Users can choose the best prompt for their model
For Maintainers
Promoting a Variant to Default
When a variant proves superior:
-
Verify test results:
cat .opencode/prompts/openagent/results/variant-results.json -
Update agent file (canonical default):
cp .opencode/prompts/openagent/variant.md .opencode/agent/openagent.md -
Update capabilities table in README
-
Commit with clear message:
git add .opencode/agent/openagent.md git commit -m "feat(openagent): promote variant to default - improved X by Y%"
Note: In the new architecture, agent files are the canonical defaults. There are no default.md files in the prompts directory.
Pull Request Guidelines
PR Title Format
Use conventional commits:
feat: add new agent for Xfix: correct issue in Y commanddocs: update Z documentationchore: update dependenciesprompt: add new variant for X model
PR Description
Include:
- What - What component are you adding/changing?
- Why - Why is this useful?
- How - How does it work?
- Testing - How did you test it?
Example:
## What
Adds a new `database-agent` for managing database migrations.
## Why
Automates common database tasks and ensures migration safety.
## How
- Scans migration files
- Validates migration order
- Runs migrations with rollback support
## Testing
- [x] Validated with `./scripts/registry/validate-component.sh`
- [x] Tested with PostgreSQL and MySQL
- [x] Tested rollback scenarios
Component Dependencies
If your component depends on others, declare them in the registry:
{
"id": "my-component",
"dependencies": ["tool:env", "agent:task-manager"]
}
The installer will automatically install dependencies.
Registry Auto-Update
The registry is automatically updated when:
- You push to
mainbranch - Changes are made to
.opencode/directory
The GitHub Action:
- Scans all components
- Extracts metadata
- Updates
registry.json - Commits changes
You don't need to manually edit registry.json!
Code Style
Markdown
- Use clear, concise language
- Include examples
- Add code blocks with syntax highlighting
- Use proper heading hierarchy
TypeScript
- Follow existing code style
- Add JSDoc comments
- Use TypeScript types (no
any) - Export functions explicitly
Bash Scripts
- Use
set -efor error handling - Add comments for complex logic
- Use meaningful variable names
- Include help text
Quick Reference
Creating a New Agent
# Use the automated system (recommended)
/create-agent my-agent-name
# Or manually follow the development guide
# See: docs/contributing/DEVELOPMENT.md#creating-new-agents
Running Tests
cd evals/framework
npm test -- --agent=my-agent
Validating Before PR
# Validate structure
./scripts/registry/validate-component.sh
# Ensure using defaults
./scripts/prompts/validate-pr.sh
# Run tests
cd evals/framework && npm test
Common Commands
# List available components
./install.sh --list
# Validate registry
make validate-registry
# Update registry
make update-registry
# Test a prompt variant
./scripts/prompts/test-prompt.sh openagent my-variant
Questions?
- Issues: Open an issue for bugs or feature requests
- Discussions: Use GitHub Discussions for questions
- Security: Email security issues privately
- Development Help: See DEVELOPMENT.md for detailed guides
License
By contributing, you agree that your contributions will be licensed under the MIT License.
Thank you for contributing! 🎉