Skip to content

chore: remove MCP conformance CI - #84

Merged
nickytonline merged 1 commit into
mainfrom
chore/remove-conformance-ci
Jul 1, 2026
Merged

chore: remove MCP conformance CI#84
nickytonline merged 1 commit into
mainfrom
chore/remove-conformance-ci

Conversation

@nickytonline

@nickytonline nickytonline commented Jul 1, 2026

Copy link
Copy Markdown
Owner

Summary

The conformance test suite is designed for MCP SDK maintainers to verify protocol implementations, not for production MCP servers. Removing it from CI and the template simplifies the project and avoids misleading people who fork this into thinking conformance tooling belongs in their own servers.

I initially thought it made sense as it was a template where I wanted to validate some things, but I didn't completely realize how the conformance tests behave so it's really not a fit for this template.

Removes:

  • .github/workflows/conformance.yml
  • conformance-baseline.yml
  • Conformance section from README.md
  • Step 5 (conformance baseline) from the create-mcp-tool skill

Generated with Devin

Related Issues

Relates to #76

AI Disclosure

Co-Authored-By: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>

I reviewed the changes.

The conformance test suite is designed for MCP SDK maintainers to verify
protocol implementations, not for production MCP servers. Removing it
from CI and the template simplifies the project and avoids misleading
people who fork this into thinking conformance tooling belongs in their
own servers.

Removes:
- .github/workflows/conformance.yml
- conformance-baseline.yml
- Conformance section from README.md
- Step 5 (conformance baseline) from the create-mcp-tool skill

Generated with [Devin](https://devin.ai)

Co-Authored-By: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
@coderabbitai

coderabbitai Bot commented Jul 1, 2026

Copy link
Copy Markdown

Review Change Stack

📝 Walkthrough

Walkthrough

Removes MCP conformance testing infrastructure: deletes the .github/workflows/conformance.yml workflow, empties conformance-baseline.yml of expected-failure entries, removes the README's MCP Conformance Testing section, and strips conformance-baseline guidance from the create-mcp-tool skill template, renumbering its verification step.

Changes

Conformance Testing Removal

Layer / File(s) Summary
CI workflow and baseline removal
.github/workflows/conformance.yml, conformance-baseline.yml
Deletes the Conformance GitHub Actions workflow and removes all expected-failure server entries from the baseline config.
Documentation and template cleanup
README.md, .agents/skills/create-mcp-tool/SKILL.md
Removes the MCP Conformance Testing section from the README and the conformance-baseline instructions from the skill template, renaming "Step 5" to "Step 5: Verify".

Estimated code review effort: 1 (Trivial) | ~5 minutes

Related PRs: None identified.

Suggested labels: documentation, ci

Suggested reviewers: nickytonline

🐰 *Hops away from tests that failed,* *Conformance checks now unveiled—* *gone from workflows, gone from docs,* *no more baseline logs to log,* *a simpler path the rabbit trailed.*
🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title accurately summarizes the main change: removing MCP conformance CI from the template.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
✨ Finishing Touches
📝 Generate docstrings
  • Create stacked PR
  • Commit on current branch
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch chore/remove-conformance-ci

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@greptile-apps

greptile-apps Bot commented Jul 1, 2026

Copy link
Copy Markdown

Greptile Summary

This PR removes all MCP conformance testing infrastructure from the template, cleaning up files that were intended for MCP SDK maintainers rather than end-users who fork the template. A full-repo search confirms no stale conformance references remain after the deletion.

  • Deletes .github/workflows/conformance.yml and conformance-baseline.yml, eliminating the conformance CI job entirely.
  • Strips the "MCP Conformance Testing" section from README.md and removes the corresponding Step 5 from the create-mcp-tool skill, renumbering the subsequent step correctly.

Confidence Score: 5/5

Safe to merge — purely removes files with no functional production code changes.

All four changes are straightforward deletions or doc edits. No functional source code is touched, no cross-references to the removed files remain in the repo, and the SKILL.md step renumbering is correct. Nothing new is introduced that could regress.

No files require special attention.

Important Files Changed

Filename Overview
.github/workflows/conformance.yml Deleted: removed the conformance CI workflow that ran MCP protocol conformance tests against the Docker image on every push/PR.
conformance-baseline.yml Deleted: removed the expected-failures baseline file that the conformance workflow depended on.
README.md Removed the 'MCP Conformance Testing' section, keeping the docs consistent with the dropped CI step.
.agents/skills/create-mcp-tool/SKILL.md Deleted the old Step 5 (conformance baseline update) and renumbered the following Verify step from Step 6 to Step 5, keeping the skill's numbered steps sequential.

Flowchart

%%{init: {'theme': 'neutral'}}%%
flowchart TD
    subgraph Before["CI Pipeline - Before"]
        A[Push or PR] --> B[lint-and-test]
        A --> C[conformance]
        C --> D[docker compose up]
        D --> E[MCP conformance action]
        E --> F[conformance-baseline.yml]
    end

    subgraph After["CI Pipeline - After"]
        G[Push or PR] --> H[lint-and-test]
    end
Loading
%%{init: {'theme': 'base', 'themeVariables': {"darkMode": true, "background": "#0d1117", "primaryColor": "#21262d", "primaryTextColor": "#e6edf3", "primaryBorderColor": "#8b949e", "lineColor": "#8b949e", "textColor": "#e6edf3", "edgeLabelBackground": "#161b22", "actorBkg": "#21262d", "actorBorder": "#8b949e", "actorTextColor": "#e6edf3", "actorLineColor": "#8b949e", "signalColor": "#8b949e", "signalTextColor": "#e6edf3", "noteBkgColor": "#373320", "noteBorderColor": "#d4a72c", "noteTextColor": "#f0e6c0", "labelBoxBkgColor": "#21262d", "labelBoxBorderColor": "#8b949e", "labelTextColor": "#e6edf3", "loopTextColor": "#e6edf3", "activationBkgColor": "#30363d", "activationBorderColor": "#8b949e"}}}%%
flowchart TD
    subgraph Before["CI Pipeline - Before"]
        A[Push or PR] --> B[lint-and-test]
        A --> C[conformance]
        C --> D[docker compose up]
        D --> E[MCP conformance action]
        E --> F[conformance-baseline.yml]
    end

    subgraph After["CI Pipeline - After"]
        G[Push or PR] --> H[lint-and-test]
    end
Loading

Reviews (1): Last reviewed commit: "chore: remove MCP conformance CI" | Re-trigger Greptile

@nickytonline
nickytonline enabled auto-merge (squash) July 1, 2026 05:35
@nickytonline
nickytonline disabled auto-merge July 1, 2026 05:36
@nickytonline
nickytonline merged commit 7f9077f into main Jul 1, 2026
12 checks passed
@nickytonline
nickytonline deleted the chore/remove-conformance-ci branch July 1, 2026 05:36
@github-actions

github-actions Bot commented Jul 1, 2026

Copy link
Copy Markdown

🎉 This PR is included in version 1.4.0 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant