* chore: update package-lock.json after npm install * chore: remove unused ajv-cli, keep vitest at stable 1.6.1 - Removed ajv-cli (unused dev dependency, had high severity vulnerability) - Kept vitest at 1.6.1 (stable, upgrading to v4 requires extensive refactoring) - Reduced vulnerabilities from 6 to 4 (all moderate, dev-only) - All remaining vulnerabilities are in esbuild/vite (dev server only, no production impact) - Build and tests verified working * feat(evals): add execution-balance validation to 21 OpenAgent tests and enhance agent system Major improvements to evaluation framework and agent capabilities: ## Execution Balance Evaluator Integration - Added execution-balance rule to 21 OpenAgent tests (2.7% → 31.5% coverage) - Validates "read before execute" pattern across critical rules, workflows, and edge cases - Tests now check: read operations before execution tools, healthy read/exec ratio (≥1.0) - Coverage includes: approval-gate, context-loading, stop-on-failure, report-first tests ## Agent System Enhancements - Enhanced OpenCoder agent with critical rules enforcement (approval gates, context loading) - Added structured delegation rules and workflow phases - Improved error handling with REPORT→PROPOSE→REQUEST→FIX pattern ## New Agent Creation System - Added research-backed agent creation templates and guides - Includes 8 test templates covering planning, context, incremental execution, tools - Automated agent scaffolding with /create-agent command - Complete documentation in .opencode/command/openagents/new-agents/ ## OpenCoder Test Suite - Added 8 comprehensive test cases for OpenCoder agent - Tests cover: planning, context-loading, delegation, error-handling, implementation - Includes DEBUG_GUIDE.md and QUICK_TEST_GUIDE.md for developers ## Documentation & Tooling - Added DEVELOPMENT.md guide for contributors - Enhanced CONTRIBUTING.md with quick reference and common commands - Improved event-logger with DEBUG_VERBOSE mode for detailed output - Added debug scripts: show-test-conversation.sh, run-test-verbose.sh - Removed deprecated EXTERNAL_PR_GUIDE.md ## Version Bump - Bumped version to 0.0.3 (patch) Files changed: 60+ files (21 test updates, 16 new agent templates, 8 new tests, docs, tooling) * feat(ci): add PR title validation for semantic versioning Add automated PR title validation to ensure conventional commit format. This enables proper automatic version bumping when PRs are merged. Features: - Validates PR titles against conventional commit patterns - Shows expected version bump (major/minor/patch) - Posts helpful comment with examples if validation fails - Supports all conventional commit types (feat, fix, docs, etc.) - Supports breaking changes (feat!, fix!) - Supports pre-release tags ([alpha], [beta], [rc]) When PR titles follow the format, version bumping works correctly: - feat: → minor bump (0.3.0 → 0.4.0) - fix: → patch bump (0.3.0 → 0.3.1) - feat!: → major bump (0.3.0 → 1.0.0) * fix(ci): improve PR checks workflow with sequential execution Reorganize PR checks to run in logical sequence and skip unnecessary checks: Changes: - Run PR title validation first (fast, always required) - Detect changed files to determine which checks to run - Only run build checks if evals/ files changed - Add comprehensive summary job showing all check results - Prevent cache errors when evals files not changed Benefits: - Faster PR checks (skip unnecessary builds) - Clear sequential execution (title → changes → build) - Better error messages and summaries - Reduced CI/CD costs * fix(ci): resolve PR #42 issues and refactor prompt architecture ## Fixed PR #42 Issues 1. **Prompt Validation** - Refactored to new architecture where agent files are canonical defaults 2. **Package-lock.json** - Fixed workflow to use root package-lock (npm workspaces) 3. **Git Merge Base** - Added fetch-depth: 0 to PR checks workflow ## New Prompt Architecture **Before:** - Agent files had to match .opencode/prompts/<agent>/default.md - Caused validation failures when updating prompts - Redundant duplication **After:** - Agent files (.opencode/agent/*.md) = Canonical defaults (source of truth) - Prompt variants (.opencode/prompts/<agent>/<model>.md) = Model-specific optimizations - No more default.md files needed ## Changes ### Workflows - pr-checks.yml: Added fetch-depth: 0 for full git history - validate-test-suites.yml: Fixed package-lock path for npm workspaces - validate-registry.yml: Updated validation messaging ### Scripts - validate-pr.sh: Validates prompt library structure (rejects default.md files) - use-prompt.sh: Handles 'default' as agent file, variants as model-specific - test-prompt.sh: Tests default variant correctly, saves results to prompts/results/ ### Documentation - .opencode/prompts/README.md: Updated architecture explanation - docs/contributing/CONTRIBUTING.md: Updated prompt workflow - scripts/development/demo.sh: Updated structure display ## Results - 12 files changed, 231 insertions(+), 811 deletions(-) - Net reduction: 580 lines (cleaner codebase) - All validations passing - Results directory structure preserved - Backwards compatible with existing test results
447 lines
11 KiB
Markdown
447 lines
11 KiB
Markdown
# Contributing to OpenAgents
|
|
|
|
Thank you for your interest in contributing! This guide will help you add new components to the registry and understand the repository structure.
|
|
|
|
## 📚 Documentation
|
|
|
|
- **[Development Guide](DEVELOPMENT.md)** - Complete guide for developing on this repo (agents, commands, tools, testing)
|
|
- **[Agent Creation System](../../.opencode/command/openagents/new-agents/README.md)** - ⭐ NEW: Research-backed agent creation with templates
|
|
- **[Code of Conduct](CODE_OF_CONDUCT.md)** - Community guidelines
|
|
- **[Adding Evaluators](ADDING_EVALUATOR.md)** - How to add new test evaluators
|
|
|
|
## Repository Structure
|
|
|
|
```
|
|
opencode-agents/
|
|
├── .opencode/
|
|
│ ├── agent/ # Agents
|
|
│ │ ├── openagent.md # Main orchestrator (always default in PRs)
|
|
│ │ ├── opencoder.md # Development specialist
|
|
│ │ └── subagents/ # Specialized subagents
|
|
│ ├── prompts/ # Prompt library (variants and experiments)
|
|
│ ├── command/ # Slash commands
|
|
│ ├── tool/ # Utility tools
|
|
│ ├── plugin/ # Integrations
|
|
│ └── context/ # Context files
|
|
├── evals/
|
|
│ ├── agents/ # Agent test suites
|
|
│ ├── framework/ # Testing framework
|
|
│ └── results/ # Test results
|
|
├── scripts/
|
|
│ ├── prompts/ # Prompt management
|
|
│ └── tests/ # Test utilities
|
|
└── docs/
|
|
├── agents/ # Agent documentation
|
|
├── contributing/ # Contribution guides
|
|
└── guides/ # User guides
|
|
```
|
|
|
|
### Key Directories
|
|
|
|
- **`.opencode/agent/`** - Main agent prompts (openagent.md, opencoder.md)
|
|
- **`.opencode/agent/subagents/`** - Specialized subagents
|
|
- **`.opencode/prompts/`** - Library of prompt variants for different models
|
|
- **`evals/`** - Testing framework and test suites
|
|
- **`scripts/`** - Automation and utility scripts
|
|
- **`docs/`** - Documentation and guides
|
|
|
|
## Quick Start
|
|
|
|
1. Fork the repository
|
|
2. Create a new branch for your feature
|
|
3. Add your component
|
|
4. Test it works
|
|
5. Submit a pull request
|
|
|
|
## Adding New Components
|
|
|
|
### Component Types
|
|
|
|
- **Agents** (`.opencode/agent/*.md`) - Main AI agents
|
|
- **Subagents** (`.opencode/agent/subagents/*.md`) - Specialized helpers
|
|
- **Commands** (`.opencode/command/*.md`) - Slash commands
|
|
- **Tools** (`.opencode/tool/*/index.ts`) - Utility tools
|
|
- **Plugins** (`.opencode/plugin/*.ts`) - Integrations
|
|
- **Contexts** (`.opencode/context/**/*.md`) - Context files
|
|
|
|
### Component Structure
|
|
|
|
#### For Markdown Files (Agents, Commands, Contexts)
|
|
|
|
All markdown files should include YAML frontmatter:
|
|
|
|
```markdown
|
|
---
|
|
description: "Brief description of what this does"
|
|
mode: primary # For agents only
|
|
temperature: 0.1 # Optional - for agents only
|
|
tools: # For agents only
|
|
read: true
|
|
edit: true
|
|
write: true
|
|
permissions: # Optional
|
|
bash:
|
|
"*": "deny"
|
|
---
|
|
|
|
# Component Name
|
|
|
|
Your component content here...
|
|
```
|
|
|
|
**Required fields:**
|
|
- `description` - Brief description (all components)
|
|
|
|
**Agent-specific fields:**
|
|
- `mode` - Agent mode (primary, secondary, etc.)
|
|
- `model` - AI model to use
|
|
- `temperature` - Temperature setting
|
|
- `tools` - Available tools
|
|
- `permissions` - Security permissions
|
|
|
|
#### For TypeScript Files (Tools, Plugins)
|
|
|
|
Include JSDoc comments at the top:
|
|
|
|
```typescript
|
|
/**
|
|
* Tool Name
|
|
*
|
|
* Brief description of what this tool does
|
|
*/
|
|
|
|
export function myTool() {
|
|
// Implementation
|
|
}
|
|
```
|
|
|
|
### File Naming Conventions
|
|
|
|
- **kebab-case** for file names: `my-new-agent.md`
|
|
- **PascalCase** for TypeScript types/interfaces
|
|
- **camelCase** for variables and functions
|
|
|
|
### Adding Your Component
|
|
|
|
1. **Create the component file** in the appropriate directory:
|
|
```bash
|
|
# Example: Adding a new agent
|
|
touch .opencode/agent/my-new-agent.md
|
|
```
|
|
|
|
2. **Add frontmatter and content** following the structure above
|
|
|
|
3. **Test your component**:
|
|
```bash
|
|
# Validate structure
|
|
./scripts/registry/validate-component.sh
|
|
```
|
|
|
|
4. **Update the registry** (automatic on merge to main):
|
|
```bash
|
|
# Manual update (optional)
|
|
./scripts/registry/register-component.sh
|
|
```
|
|
|
|
## Component Categories
|
|
|
|
When adding components, they're automatically categorized:
|
|
|
|
- **core** - Essential components included in minimal installs
|
|
- **extended** - Additional features for developer profile
|
|
- **advanced** - Experimental or specialized components
|
|
|
|
The auto-registration script assigns categories based on component type and location.
|
|
|
|
## Testing Your Component
|
|
|
|
### Local Testing
|
|
|
|
1. **Install locally**:
|
|
```bash
|
|
# Test the installer
|
|
./install.sh --list
|
|
```
|
|
|
|
2. **Validate structure**:
|
|
```bash
|
|
./scripts/registry/validate-component.sh
|
|
```
|
|
|
|
3. **Test with OpenCode**:
|
|
```bash
|
|
opencode --agent your-new-agent
|
|
```
|
|
|
|
### Automated Testing
|
|
|
|
When you submit a PR, GitHub Actions will:
|
|
- Validate component structure
|
|
- Validate prompts use defaults
|
|
- Update the registry
|
|
- Run validation checks
|
|
|
|
**Important**: PRs will fail if agents don't use their default prompts. This ensures the main branch stays stable.
|
|
|
|
## Prompt Library System
|
|
|
|
OpenCode uses a model-specific prompt library to support different AI models while keeping the main branch stable.
|
|
|
|
### How It Works
|
|
|
|
```
|
|
.opencode/
|
|
├── agent/ # Active prompts (always default in PRs)
|
|
│ ├── openagent.md
|
|
│ └── opencoder.md
|
|
└── prompts/ # Prompt library (model-specific variants)
|
|
├── openagent/
|
|
│ ├── gpt.md # GPT-4 optimized
|
|
│ ├── gemini.md # Gemini optimized
|
|
│ ├── grok.md # Grok optimized
|
|
│ ├── llama.md # Llama/OSS optimized
|
|
│ ├── TEMPLATE.md # Template for new variants
|
|
│ ├── README.md # Capabilities table
|
|
│ └── results/ # Test results (all variants)
|
|
└── opencoder/
|
|
└── ...
|
|
|
|
**Architecture:**
|
|
- Agent files (`.opencode/agent/*.md`) = Canonical defaults
|
|
- Prompt variants (`.opencode/prompts/<agent>/<model>.md`) = Model-specific optimizations
|
|
```
|
|
|
|
### For Contributors
|
|
|
|
#### Testing a Prompt Variant
|
|
|
|
```bash
|
|
# Test a specific variant
|
|
./scripts/prompts/test-prompt.sh openagent sonnet-4
|
|
|
|
# View results
|
|
cat .opencode/prompts/openagent/results/sonnet-4-results.json
|
|
```
|
|
|
|
#### Creating a New Variant
|
|
|
|
1. **Copy the template:**
|
|
```bash
|
|
cp .opencode/prompts/openagent/TEMPLATE.md .opencode/prompts/openagent/my-variant.md
|
|
```
|
|
|
|
2. **Edit your variant:**
|
|
- Add variant info (target model, focus, author)
|
|
- Document changes from default
|
|
- Write your prompt
|
|
|
|
3. **Test it:**
|
|
```bash
|
|
./scripts/prompts/test-prompt.sh openagent my-variant
|
|
```
|
|
|
|
4. **Update the README:**
|
|
- Add your variant to the capabilities table in `.opencode/prompts/openagent/README.md`
|
|
- Document test results
|
|
- Explain what it optimizes for
|
|
|
|
5. **Submit PR:**
|
|
- Include your variant file (e.g., `my-variant.md`)
|
|
- Include updated README with results
|
|
- **Do NOT change the default prompt**
|
|
- **Do NOT change `.opencode/agent/openagent.md`**
|
|
|
|
#### PR Requirements for Prompts
|
|
|
|
**All PRs must use default prompts.** CI automatically validates this.
|
|
|
|
Before submitting a PR:
|
|
```bash
|
|
# Ensure you're using defaults
|
|
./scripts/prompts/validate-pr.sh
|
|
|
|
# If validation fails, restore defaults
|
|
./scripts/prompts/use-prompt.sh openagent default
|
|
./scripts/prompts/use-prompt.sh opencoder default
|
|
```
|
|
|
|
#### Why This System?
|
|
|
|
- **Stability**: Main branch always uses tested defaults
|
|
- **Experimentation**: Contributors can optimize for specific models
|
|
- **Transparency**: Test results are documented for each variant
|
|
- **Flexibility**: Users can choose the best prompt for their model
|
|
|
|
### For Maintainers
|
|
|
|
#### Promoting a Variant to Default
|
|
|
|
When a variant proves superior:
|
|
|
|
1. **Verify test results:**
|
|
```bash
|
|
cat .opencode/prompts/openagent/results/variant-results.json
|
|
```
|
|
|
|
2. **Update agent file (canonical default):**
|
|
```bash
|
|
cp .opencode/prompts/openagent/variant.md .opencode/agent/openagent.md
|
|
```
|
|
|
|
3. **Update capabilities table** in README
|
|
|
|
4. **Commit with clear message:**
|
|
```bash
|
|
git add .opencode/agent/openagent.md
|
|
git commit -m "feat(openagent): promote variant to default - improved X by Y%"
|
|
```
|
|
|
|
**Note:** In the new architecture, agent files are the canonical defaults. There are no `default.md` files in the prompts directory.
|
|
|
|
## Pull Request Guidelines
|
|
|
|
### PR Title Format
|
|
|
|
Use conventional commits:
|
|
- `feat: add new agent for X`
|
|
- `fix: correct issue in Y command`
|
|
- `docs: update Z documentation`
|
|
- `chore: update dependencies`
|
|
- `prompt: add new variant for X model`
|
|
|
|
### PR Description
|
|
|
|
Include:
|
|
1. **What** - What component are you adding/changing?
|
|
2. **Why** - Why is this useful?
|
|
3. **How** - How does it work?
|
|
4. **Testing** - How did you test it?
|
|
|
|
Example:
|
|
```markdown
|
|
## What
|
|
Adds a new `database-agent` for managing database migrations.
|
|
|
|
## Why
|
|
Automates common database tasks and ensures migration safety.
|
|
|
|
## How
|
|
- Scans migration files
|
|
- Validates migration order
|
|
- Runs migrations with rollback support
|
|
|
|
## Testing
|
|
- [x] Validated with `./scripts/registry/validate-component.sh`
|
|
- [x] Tested with PostgreSQL and MySQL
|
|
- [x] Tested rollback scenarios
|
|
```
|
|
|
|
## Component Dependencies
|
|
|
|
If your component depends on others, declare them in the registry:
|
|
|
|
```json
|
|
{
|
|
"id": "my-component",
|
|
"dependencies": ["tool:env", "agent:task-manager"]
|
|
}
|
|
```
|
|
|
|
The installer will automatically install dependencies.
|
|
|
|
## Registry Auto-Update
|
|
|
|
The registry is automatically updated when:
|
|
- You push to `main` branch
|
|
- Changes are made to `.opencode/` directory
|
|
|
|
The GitHub Action:
|
|
1. Scans all components
|
|
2. Extracts metadata
|
|
3. Updates `registry.json`
|
|
4. Commits changes
|
|
|
|
You don't need to manually edit `registry.json`!
|
|
|
|
## Code Style
|
|
|
|
### Markdown
|
|
- Use clear, concise language
|
|
- Include examples
|
|
- Add code blocks with syntax highlighting
|
|
- Use proper heading hierarchy
|
|
|
|
### TypeScript
|
|
- Follow existing code style
|
|
- Add JSDoc comments
|
|
- Use TypeScript types (no `any`)
|
|
- Export functions explicitly
|
|
|
|
### Bash Scripts
|
|
- Use `set -e` for error handling
|
|
- Add comments for complex logic
|
|
- Use meaningful variable names
|
|
- Include help text
|
|
|
|
## Quick Reference
|
|
|
|
### Creating a New Agent
|
|
|
|
```bash
|
|
# Use the automated system (recommended)
|
|
/create-agent my-agent-name
|
|
|
|
# Or manually follow the development guide
|
|
# See: docs/contributing/DEVELOPMENT.md#creating-new-agents
|
|
```
|
|
|
|
### Running Tests
|
|
|
|
```bash
|
|
cd evals/framework
|
|
npm test -- --agent=my-agent
|
|
```
|
|
|
|
### Validating Before PR
|
|
|
|
```bash
|
|
# Validate structure
|
|
./scripts/registry/validate-component.sh
|
|
|
|
# Ensure using defaults
|
|
./scripts/prompts/validate-pr.sh
|
|
|
|
# Run tests
|
|
cd evals/framework && npm test
|
|
```
|
|
|
|
### Common Commands
|
|
|
|
```bash
|
|
# List available components
|
|
./install.sh --list
|
|
|
|
# Validate registry
|
|
make validate-registry
|
|
|
|
# Update registry
|
|
make update-registry
|
|
|
|
# Test a prompt variant
|
|
./scripts/prompts/test-prompt.sh openagent my-variant
|
|
```
|
|
|
|
## Questions?
|
|
|
|
- **Issues**: Open an issue for bugs or feature requests
|
|
- **Discussions**: Use GitHub Discussions for questions
|
|
- **Security**: Email security issues privately
|
|
- **Development Help**: See [DEVELOPMENT.md](DEVELOPMENT.md) for detailed guides
|
|
|
|
## License
|
|
|
|
By contributing, you agree that your contributions will be licensed under the MIT License.
|
|
|
|
---
|
|
|
|
Thank you for contributing! 🎉
|