Skip to content

Product analysis (PRD, PM, UX/UI, algorithm) + landing conversion edits - #31

Merged
criptogus merged 2 commits into
mainfrom
claude/vigilant-clarke-TMUjV
May 29, 2026
Merged

criptogus merged 2 commits into
mainfrom
claude/vigilant-clarke-TMUjV

Conversation

@criptogus

Copy link
Copy Markdown
Owner

What this delivers

A full product analysis of Super Agent Skill plus high-confidence conversion edits to the landing page. Analysis lives in docs/product/.

1. PRD — docs/product/PRD.md

Problem, vision, personas, the four primitives, current flows/pricing, the Trust Score formula, proposed North-Star metrics, instrumentation, risks, roadmap.

2. Landing page conversion edits — src/routes/index.tsx

Goal: simpler message, lead with ease + benefits, fix credibility bugs.

  • Benefit-first hero subcopy + a 3-item "why it's worth 30s" cue strip (no code · 30s · jailbreak-tested).
  • Fixed count inconsistency: HowItWorks said "4,200+ experts" while the hero says "459+" → unified to "hundreds of".
  • Unified metric naming: testimonial "Health Score" → "Trust Score" (matches the product's actual metric everywhere else).
  • Fixed license label: "MIT-style" → "Apache 2.0 · CC BY-SA" (the repo's real license).

3. PM feature analysis — docs/product/PM-FEATURE-ANALYSIS.md

15 prioritized opportunities (RICE-framed) across activation, trust moat, flywheel, ARPU, virality — with a suggested sequencing and the metric each bet should move.

4. UX/UI audit — docs/product/UX-UI-AUDIT.md

Critical (count/naming/license/fake-testimonial risks), high-impact conversion (message overload, jargon above the fold, competing CTAs, MCP literacy), plus medium/polish and app-surface notes. The quick wins are implemented in this PR.

5. Evaluation-algorithm analysis — docs/product/EVALUATION-ALGORITHM-ANALYSIS.md

End-to-end breakdown of the proprietary stack (adversarial harness, type-aware evaluator weights, the daily Trust Score formula, SkillForge evolution loop), its weaknesses (substring grading is gameable, 0.5 defaults reward absence of evidence, no recency/confidence weighting, static suite, Goodhart risk in the Forge gate), and a Trust Score v2 hardening plan (Wilson lower-bound, evidence-gating, recency/model-aware scores, LLM-judge+holdout suite, reproducible signed methodology) to make the moat uncopyable.

Notes

  • Docs are advisory; the only code change is copy/markup in the home route.
  • Could not run typecheck/lint/build in this container — node_modules isn't installed (vite/client and @eslint/js missing). The edits are JSX copy/list changes and were verified by inspection.

https://claude.ai/code/session_01BnYrQNoKNNxPCSmV2suWna


Generated by Claude Code

claude added 2 commits May 29, 2026 18:23
…rsion edits

- docs/product/PRD.md: product requirements doc
- docs/product/PM-FEATURE-ANALYSIS.md: prioritized feature opportunities
- docs/product/UX-UI-AUDIT.md: UX/UI findings + quick wins
- docs/product/EVALUATION-ALGORITHM-ANALYSIS.md: Trust Score / SkillForge analysis + hardening plan
- Landing: benefit-first hero copy + ease cues, fix count inconsistency (4,200+ → hundreds),
  unify Trust Score naming, correct license label (Apache 2.0 / CC BY-SA)
Landing page:
- Remove SocialProof entirely (illustrative testimonials erode trust)
- Remove redundant SkillLayerManifesto + NetworkSection; ease-first reorder
- MCP tool picker (Claude/Cursor/ChatGPT/Other) swaps connect steps
- Single primary CTA + quiet secondary link; benefit cues in hero
- Unify counts + Trust Score naming; fix license label

Trust Score v2 (evidence-gated, reproducible):
- src/lib/trust/scoring.ts: Wilson lower-bound, confidence gating with
  verified flag (no more 0.5 defaults), freshness term, multi-dim vector
- supabase migration recompute_trust_scores_v2() mirrors it in SQL + repoints cron
- src/lib/adversarial/holdout.ts: deterministic salt-rotatable train/holdout split
- tests: trust-scoring + adversarial-holdout (12 cases, all green)
- docs updated to reflect what shipped
@criptogus
criptogus marked this pull request as ready for review May 29, 2026 18:40
@criptogus
criptogus merged commit 5e8a40f into main May 29, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants