Skip to content

feat(examples): add session replay, tool security, eval pipeline (#89, #90, #91)#166

Open
xyaohubery wants to merge 3 commits into
trpc-group:mainfrom
xyaohubery:feat/session-replay-tool-sec-eval
Open

feat(examples): add session replay, tool security, eval pipeline (#89, #90, #91)#166
xyaohubery wants to merge 3 commits into
trpc-group:mainfrom
xyaohubery:feat/session-replay-tool-sec-eval

Conversation

@xyaohubery

Copy link
Copy Markdown

Summary

Three new examples for the tRPC-Agent SDK:

#89: Session/Memory Replay Testing

  • Multi-backend replay consistency verification
  • Compares responses across backends
  • Supports InMemory, Redis, SQL session/memory backends

#90: Tool Security Scanning

  • Pattern-based security scanning (shell injection, path traversal, network exfil, etc.)
  • Filter/block policy for dangerous tools
  • Integrity checks (size limits, JSON depth)

#91: Evaluation + Optimization Pipeline

  • Built-in eval test cases with keyword-based scoring
  • Auto-regression across prompt iterations
  • Iterative prompt optimization with Hy3-powered analysis

Fixes #89, Fixes #90, Fixes #91

Assisted-by: claude-code:deepseek-v4-pro

- Automated code review agent using trpc-agent-sdk + Hy3 LLM
- Structured review with bug/security/improvement detection
- SQLite persistence for review results
- OpenAI-compatible model config (works with Hy3 API)

Fixes trpc-group#92

Assisted-by: claude-code:deepseek-v4-pro
…trpc-group#89, trpc-group#90, trpc-group#91)

- Session/Memory multi-backend replay consistency testing framework
- Tool execution security scanning with filter/monitoring
- Evaluation + Optimization auto-regression pipeline
- All built on trpc-agent-sdk with Hy3 LLM backend

Fixes trpc-group#89, Fixes trpc-group#90, Fixes trpc-group#91

Assisted-by: claude-code:deepseek-v4-pro
@github-actions

github-actions Bot commented Jul 12, 2026

Copy link
Copy Markdown

CLA Assistant Lite bot All contributors have signed the CLA ✍️ ✅

@codecov

codecov Bot commented Jul 12, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
⚠️ Please upload report for BASE (main@e113610). Learn more about missing BASE report.

Additional details and impacted files
@@            Coverage Diff             @@
##             main        #166   +/-   ##
==========================================
  Coverage        ?   87.54280%           
==========================================
  Files           ?         467           
  Lines           ?       44103           
  Branches        ?           0           
==========================================
  Hits            ?       38609           
  Misses          ?        5494           
  Partials        ?           0           

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@xyaohubery

Copy link
Copy Markdown
Author

I have read the CLA Document and I hereby sign the CLA

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

1 participant