OpenWriterControle/evals/opencode/openagent/tests/simple/conversational-pass/timeline.json
darrenhinde 478c8e3e85 feat: implement SDK-based evaluation framework with real agent testing
- Replace planned framework with working SDK implementation using @opencode-ai/sdk
- Add 6 YAML test cases across developer/business/edge-case categories (100% passing)
- Implement 4 evaluators for openagent.md rule compliance (approval-gate, context-loading, delegation, tool-usage)
- Add real-time event streaming and session recording
- Configure opencode/grok-code-fast as default model (zero API costs)
- Add comprehensive documentation (SDK_EVAL_README.md, test-design-guide.md, TEST_SCENARIOS.md)
- Support v2 schema with behavior-based expectations instead of message counts
- Enable model-agnostic test design that works across Claude, GPT-4, and Grok
- Add subagent invocation syntax documentation to openagent.md
2025-11-22 14:30:11 +00:00

31 lines
660 B
JSON

[
{
"timestamp": 1000,
"type": "user_message",
"messageId": "msg_test_001",
"data": {
"text": "What does this code do?"
}
},
{
"timestamp": 1100,
"type": "tool_call",
"messageId": "msg_test_002",
"data": {
"tool": "read",
"input": {
"filePath": "app.ts"
},
"status": "completed",
"output": "function hello() { return 'hi'; }"
}
},
{
"timestamp": 1200,
"type": "text",
"messageId": "msg_test_002",
"data": {
"text": "This code defines a simple function called `hello` that returns the string 'hi'. It's a basic TypeScript function."
}
}
]