OpenWriterControle/evals/opencode/openagent/tests/simple/context-loaded-pass/timeline.json
darrenhinde 478c8e3e85 feat: implement SDK-based evaluation framework with real agent testing
- Replace planned framework with working SDK implementation using @opencode-ai/sdk
- Add 6 YAML test cases across developer/business/edge-case categories (100% passing)
- Implement 4 evaluators for openagent.md rule compliance (approval-gate, context-loading, delegation, tool-usage)
- Add real-time event streaming and session recording
- Configure opencode/grok-code-fast as default model (zero API costs)
- Add comprehensive documentation (SDK_EVAL_README.md, test-design-guide.md, TEST_SCENARIOS.md)
- Support v2 schema with behavior-based expectations instead of message counts
- Enable model-agnostic test design that works across Claude, GPT-4, and Grok
- Add subagent invocation syntax documentation to openagent.md
2025-11-22 14:30:11 +00:00

59 lines
1.1 KiB
JSON

[
{
"timestamp": 1000,
"type": "user_message",
"messageId": "msg_test_001",
"data": {
"text": "Create a new file hello.ts"
}
},
{
"timestamp": 1100,
"type": "text",
"messageId": "msg_test_002",
"data": {
"text": "I'll create hello.ts for you. Let me first load the code standards."
}
},
{
"timestamp": 1200,
"type": "tool_call",
"messageId": "msg_test_002",
"data": {
"tool": "read",
"input": {
"filePath": ".opencode/context/core/standards/code.md"
},
"status": "completed"
}
},
{
"timestamp": 1300,
"type": "text",
"messageId": "msg_test_003",
"data": {
"text": "Would you like me to create hello.ts with TypeScript?"
}
},
{
"timestamp": 1400,
"type": "user_message",
"messageId": "msg_test_004",
"data": {
"text": "Yes"
}
},
{
"timestamp": 1500,
"type": "tool_call",
"messageId": "msg_test_005",
"data": {
"tool": "write",
"input": {
"filePath": "hello.ts",
"content": "console.log('Hello, world!');"
},
"status": "completed"
}
}
]