feat: publish standalone AI Tell Scan skill - #1
Conversation
bestony
left a comment
There was a problem hiding this comment.
Findings
-
[High] The hosted campaign cannot scan its representative First Tree target. The bounded checkout succeeds, but scanning the resulting public
agent-team-foundation/first-treesource (currentmaincommit328dfd40a8ea2cd4aa458176bb822f7b081475bd, 998 eligible files / 244 UI files) exits withRule source-window work limit exceeded (2000000); narrow the scan root.fromMAX_RULE_WINDOW_CHARSin.claude/skills/ai-tell-scan/scripts/ats_core.py:41while evaluating_aurora_centered_hero. Becausebin/ats-scan.pypropagates that error, the hosted flow produces noats-1artifact or report URL for the public repository the PR body names as a successful real-repository verification. A bounded work limit is useful, but this path needs to return a limitation-qualified report or otherwise budget/skip per-rule work so the campaign can complete on the intended target; add a regression using a representative large repository. -
[Medium] The new public repository does not satisfy the organization’s open-source documentation baseline. The tree’s
customer/open-source/repository-structurecontract requiresDEVELOPMENT.md,CODE_OF_CONDUCT.md, and Chinese counterparts for public/contributor-facing docs (README.zh-CN.md,CONTRIBUTING.zh-CN.md, andSECURITY.zh-CN.md). This PR adds onlyREADME.md,CONTRIBUTING.md, andSECURITY.md, leaving a public standalone repository without the setup, conduct/reporting, and bilingual entry points that the ecosystem contract requires. Add those documents (with canonical-source/sync notes for translations), or split the explicitly deferred documentation into a tracked follow-up before publishing this repository as the campaign’s public source of truth.
The scanner/unit and renderer/repository suites pass at this head, but they do not exercise the representative hosted scan or the required public-repository documentation set.
bestony
left a comment
There was a problem hiding this comment.
Review outcome
The previous blockers are resolved at this head. The bounded hosted checkout and scan of agent-team-foundation/first-tree now complete (998 eligible files, 244 UI files, completed), and the new representative large-repository regression covers the per-rule budget fix. The public repository documentation baseline, translations, CODEOWNERS, and issue forms are also present.
Verification: scanner suite 39/39, renderer/repository suite 14/14, controlled evaluation passed (1.0000 candidate and confirmed precision), skill validation, compileall, and Python 3.11/3.12 CI checks passed.
Non-blocking note: git diff --check still reports trailing whitespace on the two-space Markdown hard-break lines in the five *.zh-CN.md files. The PR body should not claim that check passes unless those lines are normalized or the intentional Markdown breaks are excluded from that claim.
Outcome
Creates the independent public AI Tell Scan repository as the single source of truth for the campaign scanner and agent skill. First Tree clones this repository at trial runtime; no scanner or bundled skill is copied into the product repository.
What is included
ats-1schema plus checked JSON and self-contained, script-free HTML example;Verification
agent-team-foundation/first-treecommit328dfd40a8ea2cd4aa458176bb822f7b081475bdcompletes without executing target code: 998 eligible files, 244 UI files, 10 rules, 0 candidatesad8c7491541294c944048019c148479c27f5f8f6bestonyapproved that exact commit after independently re-running the representative hosted scan, both test suites, the controlled evaluation, and the public-documentation contractConnected replacements
Release order
main;The corpus is a regression gate, not a population-wide accuracy claim. The scan reports visible composition evidence and never infers authorship or emits an AI percentage.