- Replace planned framework with working SDK implementation using @opencode-ai/sdk - Add 6 YAML test cases across developer/business/edge-case categories (100% passing) - Implement 4 evaluators for openagent.md rule compliance (approval-gate, context-loading, delegation, tool-usage) - Add real-time event streaming and session recording - Configure opencode/grok-code-fast as default model (zero API costs) - Add comprehensive documentation (SDK_EVAL_README.md, test-design-guide.md, TEST_SCENARIOS.md) - Support v2 schema with behavior-based expectations instead of message counts - Enable model-agnostic test design that works across Claude, GPT-4, and Grok - Add subagent invocation syntax documentation to openagent.md
60 lines
1.4 KiB
JSON
60 lines
1.4 KiB
JSON
[
|
|
{
|
|
"timestamp": 1000,
|
|
"type": "user_message",
|
|
"messageId": "msg_test_001",
|
|
"data": {
|
|
"text": "Create a login feature with components, tests, docs, and types"
|
|
}
|
|
},
|
|
{
|
|
"timestamp": 1100,
|
|
"type": "text",
|
|
"messageId": "msg_test_002",
|
|
"data": {
|
|
"text": "This task involves creating 4+ files. Let me delegate to task-manager for proper breakdown."
|
|
}
|
|
},
|
|
{
|
|
"timestamp": 1200,
|
|
"type": "tool_call",
|
|
"messageId": "msg_test_003",
|
|
"data": {
|
|
"tool": "read",
|
|
"input": {
|
|
"filePath": ".opencode/context/core/workflows/delegation.md"
|
|
},
|
|
"status": "completed"
|
|
}
|
|
},
|
|
{
|
|
"timestamp": 1300,
|
|
"type": "text",
|
|
"messageId": "msg_test_003",
|
|
"data": {
|
|
"text": "Would you like me to delegate this to task-manager to break it down into subtasks?"
|
|
}
|
|
},
|
|
{
|
|
"timestamp": 1400,
|
|
"type": "user_message",
|
|
"messageId": "msg_test_004",
|
|
"data": {
|
|
"text": "Yes, please"
|
|
}
|
|
},
|
|
{
|
|
"timestamp": 1500,
|
|
"type": "tool_call",
|
|
"messageId": "msg_test_005",
|
|
"data": {
|
|
"tool": "task",
|
|
"input": {
|
|
"subagent_type": "subagents/core/task-manager",
|
|
"description": "Break down login feature",
|
|
"prompt": "Break down login feature into subtasks: components, tests, docs, types"
|
|
},
|
|
"status": "completed"
|
|
}
|
|
}
|
|
]
|