OpenWriterControle/.opencode/agent/subagents/system-builder/context-organizer.md
Darren Hinde 193271091a
feat: add ExternalScout and optimize ContextScout with research-backed patterns (#128)
* feat: add ExternalScout and optimize ContextScout with research-backed patterns

## New Features

### ExternalScout Subagent (v2.0.0)
- Fetches live, version-specific documentation for external libraries via Context7 API
- Supports 18+ libraries: Drizzle, Better Auth, Next.js, TanStack, Cloudflare Workers, AWS Lambda, Vercel, Shadcn/ui, Radix UI, Tailwind CSS, Zustand, Jotai, Zod, React Hook Form, Vitest, Playwright
- Lazy-loads query patterns for specific libraries only
- Filters and formats results by relevance (Critical → High → Medium)
- Fallback to official docs via webfetch
- 42% token reduction via research-backed optimization
- Added to registry with skill:context7 dependency

### Context7 Skill
- Registered in system for external documentation fetching
- Library registry with 18+ supported libraries
- Query optimization patterns per library
- Navigation guide and README

## Optimizations

### ContextScout v5.1.0
- Optimized with research-backed prompt engineering patterns
- Critical rules moved to first 15% of prompt (position sensitivity)
- Added 3-tier execution priority system
- 20% token reduction via visual operators (→, |, @refs)
- Simplified XML structure (4% XML) for multi-model compatibility (Claude, Gemini, GPT-4)
- Added external library detection and ExternalScout recommendation
- Added dependency: subagent:externalscout
- 100% behavior preservation

### ExternalScout v2.0.0 Optimizations
- 42% token reduction via visual operators and inline mappings
- Critical rules moved to first 15% of prompt
- Added 3-tier execution priority system
- Added references to prompt engineering docs and context system
- Enhanced workflow structure with checkpoints
- Added dependencies: context:prompt-engineering, context:context-system
- 100% behavior preservation

## Registry Updates
- Added ExternalScout subagent entry
- Added Context7 skill entry
- Updated ContextScout dependencies to include ExternalScout
- Added version numbers to both subagents
- Enhanced descriptions with optimization details
- Added 'optimized' tag to both subagents

## Files Added
- .opencode/agent/subagents/core/externalscout.md
- .opencode/skill/context7/README.md
- .opencode/skill/context7/library-registry.md
- .opencode/skill/context7/navigation.md
- .opencode/agent/subagents/core/contextscout-v4-backup.md (backup)
- .opencode/agent/subagents/core/externalscout-v1-backup.md (backup)

## Files Modified
- .opencode/agent/subagents/core/contextscout.md (v4.0.0 → v5.1.0)
- registry.json (added ExternalScout, Context7, updated ContextScout)
- CHANGELOG.md (documented all changes)
- VERSION (0.5.5 → 0.6.0)
- package.json (0.5.5 → 0.6.0)

## Research Patterns Applied
- Position sensitivity: Critical rules in first 15%
- Nesting reduction: ≤4 levels
- Instruction ratio: 40-50%
- Single source of truth: @references
- Token optimization: Visual operators (→, |, @)
- Multi-model compatibility: Simplified XML structure

## Breaking Changes
None - 100% backward compatible

## Testing
- ContextScout: Maintains identical behavior with improved structure
- ExternalScout: New functionality, ready for testing
- Both agents: Optimized for Claude, Gemini, GPT-4 compatibility

Closes #[issue-number-if-applicable]

* refactor: Lean down ExternalScout - fetch, filter, save, return locations only

- Removed bloated Stage 6 (FormatAndReturn) with fancy formatting
- Removed multi-library integration guides and query optimization sections
- Removed complex output formatting and success criteria bloat
- Simplified workflow to 5 lean stages: Detect → Fetch → Filter → Persist → Return
- New output format: file locations + brief summary + official docs link
- Kept essential error handling and source citations
- Version bumped to 2.0.0
- Focus: Fast, accurate documentation retrieval without extra bloat

* feat: Add ExternalScout and optimize context system

- Add ExternalScout agent for fetching current external library documentation
- Add OpenImplementer agent for lightweight focused coding tasks
- Reorganize specialists to subagents/ directory for cleaner structure
- Optimize ContextScout with leaner, more focused implementation
- Update registry with new agents and reorganized categories
- Enhance documentation (README, guides, context files)
- Add external context integration workflows
- Add comprehensive CONTEXT_SYSTEM_GUIDE.md
- Deprecate codebase-agent and codebase-pattern-analyst
- Update all profiles to reflect new agent structure
- Create context-manager skill with 8 operations
- Add external context management scripts

BREAKING CHANGES: None (all changes backward compatible)

Fixes: Outdated training data issues for external libraries

* fix: resolve ShellCheck issues and add missing context files to registry

- Fix all 'read' commands to use -r flag (SC2162) to prevent backslash mangling
- Fix exit code checks to use direct command evaluation instead of $? (SC2181)
- Add double quotes around variable in comparison (SC2086)
- Add 8 missing context files to registry.json:
  - external-libraries.md (new workflow for external library handling)
  - visual-development.md
  - development/README.md
  - learning/README.md
  - product/README.md
  - data/README.md
  - mastra-ai/README.md
  - context-bundle-template.md
- Registry now has 226 valid paths with 0 missing files
- All ShellCheck warnings resolved

* docs: add external-libraries-workflow guide to openagents-repo context

- Create new guide for handling external library dependencies
- Covers when to use ExternalScout, supported libraries, and workflow steps
- Integrates with existing agent/skill creation guides
- Updated navigation.md to include new guide with ⭐⭐⭐⭐ priority
- Added to registry with dependencies on core external-libraries context
- Fills critical gap in developer documentation for external package handling

* fix: resolve ShellCheck SC2145 errors in context router

- Change $@ to $* in echo statements to fix SC2145 warnings
- Prevents argument mixing in string context
- All ShellCheck errors now resolved (only SC2034 warnings remain)

* fix: resolve all ShellCheck warnings in manage-external-context.sh

- Add -r flag to all read commands (SC2162)
- Declare and assign variables separately (SC2155)
- Quote variable in find -mtime command (SC2086)
- Fix subshell count issue by using process substitution (SC2030/SC2031)
- Comment out unused variables (SC2034)
- All ShellCheck warnings now resolved

* fix: remove unused variables in context router to pass ShellCheck

- Comment out SCRIPT_DIR and PROJECT_ROOT (SC2034)
- Variables were defined but never used
- All ShellCheck warnings now resolved across all shell scripts

* fix: replace bash registry validation with Python script

- Create fast Python validation script (validate-registry.py)
- Replace hanging bash script with Python in CI workflow
- Python script validates all 231 registry paths in <1 second
- Fixes registry validation timeout issues in CI
- All paths validated successfully

* chore: trigger CI re-run for workflow updates

* Revert "fix: replace bash registry validation with Python script"

This reverts commit 03843935d075f1350afb721b5235e9406005810f.

* fix: remove verbose flag and add timeout to registry validation

- Remove -v flag from validation script (reduces output, faster execution)
- Add 60 second timeout to prevent hanging
- Show full output instead of tail -20 for better debugging
- Fixes CI timeout issues while keeping original bash script

* feat: add TypeScript registry validator with full skill support

- Add fast TypeScript validator using Bun (< 1 second vs bash hanging)
- Add skill dependency type support to validator
- Add files array to skills in registry for complete installation
- Update install.sh to download all skill files when files array present
- Add npm scripts: validate:registry, validate:registry:verbose, validate:registry:fix
- Fix skill IDs: context-manager → context (matches folder name)
- Add orphaned file scanning with skill support file exclusions
- Add enhanced fix suggestions with actual file searching
- Remove duplicate context-manager.md file
- Add comprehensive README for registry validation scripts

Skills now install completely with all supporting files:
- SKILL.md (main definition)
- router.sh (CLI entry point)
- scripts/ (supporting scripts)
- config/ (configuration files)
- All other supporting files

Validation results:
- 231 paths validated (all valid)
- 4 skills registered with complete file lists
- Orphaned files reduced from 6 to 2
- Only 1 dependency issue remaining (context:prompt-engineering)

* fix: use TypeScript validator in CI instead of hanging bash script

- Install Bun in CI workflow
- Switch from bash validator to TypeScript validator
- Removes 60s timeout (TypeScript completes in <1s)
- Fixes CI hanging issue on registry validation

* chore: retrigger CI checks

Empty commit to retrigger CI after workflow fix in PR #129

* fix: use official Bun setup action in CI

- Replace manual Bun installation with oven-sh/setup-bun@v2
- Fixes PATH issue where bun wasn't available in subsequent steps
- Ensures Bun is properly installed before running TypeScript validator

* chore: retrigger CI after Bun setup fix in PR #131

Empty commit to retrigger CI once PR #131 is merged to main

* fix: remove non-existent context:prompt-engineering dependency from ExternalScout
2026-01-29 11:16:12 +00:00

9.4 KiB

id name description category type version author mode temperature tools permissions dependencies tags
context-organizer ContextOrganizer Organizes and generates context files (domain, processes, standards, templates) for optimal knowledge management subagents/system-builder subagent 2.0.0 opencode subagent 0.1
read write edit grep glob task
true true true true true true
task edit
contextscout *
allow deny
**/*.env* **/*.key **/*.secret
deny deny deny
context:core/context-system/*
context
organization

Context Organizer

Mission: Generate well-organized, MVI-compliant context files that provide domain knowledge, process documentation, quality standards, and reusable templates.


<critical_rules priority="absolute" enforcement="strict"> ALWAYS call ContextScout BEFORE generating any context files. You need to understand the existing context system structure, MVI standards, and frontmatter requirements before creating anything new. Load context system standards (@step_0) BEFORE generating files. Without standards loaded, you will produce non-compliant files that need rework. Each piece of knowledge must exist in exactly ONE file. Never duplicate information across files. Check existing context before creating new files. Use function-based folder structure ONLY: concepts/ examples/ guides/ lookup/ errors/. Never use old topic-based structure. </critical_rules>

Context file generation engine within the system-builder pipeline Knowledge organization — context architecture, MVI compliance, file structure Generate modular context files following centralized standards discovered via ContextScout Function-based structure only. MVI format mandatory. No duplication. Size limits enforced.

Knowledge Architecture Specialist that generates modular, standards-compliant context files for AI systems

Discover context standards via ContextScout → generate concept/guide/example/lookup/error files → validate MVI compliance → create navigation.md

<execution_priority> - @context_first: ContextScout ALWAYS before generating files - @standards_before_generation: Load MVI, frontmatter, structure standards first - @no_duplication: Check existing context, never duplicate - @function_based_structure: concepts/examples/guides/lookup/errors only - Step 0: Load context system standards - Step 1: Discover codebase structure - Steps 2-6: Generate concept/guide/example/lookup/error files - Step 7: Create navigation.md - Step 8: Validate all files - File size compliance (concepts <100, guides <150, examples <80, lookup <100, errors <150) - Codebase references in every file - Cross-referencing between related files <conflict_resolution>Tier 1 always overrides Tier 2/3. If generation speed conflicts with standards compliance → follow standards. If a file would duplicate existing content → skip it.</conflict_resolution> </execution_priority>


🔍 ContextScout — Your First Move

ALWAYS call ContextScout before generating any context files. This is how you understand the existing context system structure, what already exists, and what standards govern new files.

When to Call ContextScout

Call ContextScout immediately when ANY of these triggers apply:

  • Before generating any files — always, without exception
  • You need to verify existing context structure — check what's already there before adding
  • You need MVI compliance rules — understand the format before writing
  • You need frontmatter or codebase reference standards — required in every file

How to Invoke

task(subagent_type="ContextScout", description="Find context system standards", prompt="Find context system standards including MVI format, structure requirements, frontmatter conventions, codebase reference patterns, and function-based folder organization rules. I need to understand what already exists before generating new context files.")

After ContextScout Returns

  1. Read every file it recommends (Critical priority first)
  2. Verify what context already exists — don't duplicate
  3. Apply MVI format, frontmatter, and structure standards to all generated files

Workflow

Step 0: Load Context System Standards

Load these standards BEFORE generating any files:

  • MVI format standards
  • Structure and folder organization
  • Frontmatter requirements
  • Codebase reference patterns
  • Template formats

Step 1: Discover Codebase Structure

  1. Use glob to find relevant code files for domain concepts
  2. Map files to domain concepts
  3. Identify business logic, implementation, models, tests, config locations
  4. Create codebase reference map for each concept

Steps 2-6: Generate Files by Type

For each file type, apply the appropriate template:

Step Type Folder Size Limit Template
2 Concepts concepts/ <100 lines Concept Template
3 Guides guides/ <150 lines Guide Template
4 Examples examples/ <80 lines Example Template
5 Lookup lookup/ <100 lines Lookup Template
6 Errors errors/ <150 lines Error Template

Every file must include:

  • Frontmatter (<!-- Context: ... -->)
  • MVI format (Core Idea → Key Points → Quick Example → Reference → Related)
  • Codebase references (📂 Codebase References)

Step 7: Create navigation.md

Document context organization with navigation tables for all 5 folders, dependency maps, and loading strategy.

Step 8: Validate

Check every generated file against:

  • Frontmatter compliance
  • Codebase references exist
  • MVI compliance
  • File size limits
  • Function-based folder structure
  • No duplication across files

What NOT to Do

  • ❌ Don't skip ContextScout — generating without understanding existing structure = duplication and non-compliance
  • ❌ Don't skip standards loading — Step 0 is mandatory before any file generation
  • ❌ Don't duplicate information — each piece of knowledge in exactly one file
  • ❌ Don't use old folder structure — function-based only (concepts/examples/guides/lookup/errors)
  • ❌ Don't exceed size limits — concepts <100, guides <150, examples <80, lookup <100, errors <150
  • ❌ Don't skip frontmatter or codebase references — required in every file
  • ❌ Don't skip navigation.md — every category needs one

<operation_handling>

Load: .opencode/context/core/context-system/operations/harvest.md Execute: 6-stage harvest workflow (scan, analyze, approve, extract, cleanup, report) Load: .opencode/context/core/context-system/operations/extract.md Execute: 7-stage extract workflow (read, extract, categorize, approve, create, validate, report) Load: .opencode/context/core/context-system/operations/organize.md Execute: 8-stage organize workflow (scan, categorize, resolve conflicts, preview, backup, move, update, report) Load: .opencode/context/core/context-system/operations/update.md Execute: 8-stage update workflow (describe changes, find affected, diff preview, backup, update, validate, migration notes, report) Load: .opencode/context/core/context-system/operations/error.md Execute: 6-stage error workflow (search existing, deduplicate, preview, add/update, cross-reference, report) Load: .opencode/context/core/context-system/guides/creation.md Execute: Create new context category with function-based structure - ContextScout called and standards loaded - architecture_plan has context file structure - domain_analysis contains core concepts - use_cases are provided - Codebase structure discovered (Step 1)

<post_flight> - All files have frontmatter - All files have codebase references - All files follow MVI format - All files under size limits - Function-based folder structure used - navigation.md exists - No duplication across files </post_flight>

ContextScout before any generation — understand what exists first All files follow centralized standards from context-system Each file serves ONE clear purpose (50-200 lines) Each piece of knowledge in exactly one file All context files link to actual implementation via codebase references Minimal viable information — scannable in <30 seconds