Add simple SKILL to run it with or without mtool to measure the performances

[cmoulliard]

• Add simple SKILL to test mtool or without mtool
• Create a python run-skill.py script able to run the simple skills and prepare the environment

Verify first if python3 is installed and venv exists. See: https://gist.github.com/basperheim/17e169478aa1be3cacbd9c530afeb155

python3 -V
cd tests
python3 -m venv .venv
source .venv/bin/activate.fish or source .venv/bin/activate

// DON'T FORGET TO SOURCE OR EXPORT AI env var for opencode !!

// To leave the python venv, execute the command
# leave the venv
deactivate

The simple SKILL can be tested using the python script and this command

./scripts/run-skill.py migrate-simple-without-mtool
or
./scripts/run-skill.py migrate-simple-with-mtool
════════════════════════════════════════════════════════════
  Skill:   migrate-simple-without-mtool
  Project: spring-boot-todo-app
  Model:   google-vertex-anthropic/claude-opus-4-6@default
  Source:  /Users/cmoullia/code/quarkus/fork-quarkus-skills/tests/projects/spring-boot-todo-app/source
  Title:   spring-boot-todo-app_migrate-simple-without-mtool_2026-07-14_09-10
  Report:  /Users/cmoullia/code/quarkus/fork-quarkus-skills/tests/reports/migrate-simple-without-mtool/spring-boot-todo-app_migrate-simple-without-mtool_2026-07-14_09-10.md
...

See the report generated under tests/reports/migrate-simple-without-mtool ...

[aureamunoz]

I tested both skills locally and got the same error on both:

Error: File not found: /Users/auri/Code/quarkus-skills/tests/.opencode/skills/shared/migration-steps.md

The issue is that the run-skill.py script symlinks the shared file to .opencode/shared/migration-steps.md, but both skills reference ../shared/migration-steps.md which from .opencode/skills/SKILL.md resolves to .opencode/skills/shared/ instead of .opencode/shared/.

Either the symlink structure in the script needs to place shared content inside .opencode/skills/shared/, or the relative paths in the SKILL.md files need updating.

[cmoulliard]

I tested both skills locally and got the same error on both:

I cannot reproduce the error. I deleted under tests folder => .opencode folder, launched the python script and here is the symlinks created which looks correct for me

❯ ls -la /Users/cmoullia/code/quarkus/fork-quarkus-skills/tests/.opencode/shared/
total 0
drwxr-xr-x@ 3 cmoullia  staff   96 Jul 14 12:47 ./
drwxr-xr-x@ 5 cmoullia  staff  160 Jul 14 12:47 ../
lrwxr-xr-x@ 1 cmoullia  staff   87 Jul 14 12:47 migration-steps.md@ -> /Users/cmoullia/code/quarkus/fork-quarkus-skills/tests/skills/shared/migration-steps.md

❯ ls -la /Users/cmoullia/code/quarkus/fork-quarkus-skills/tests/.opencode/skills/
total 0
drwxr-xr-x@ 3 cmoullia  staff   96 Jul 14 12:47 ./
drwxr-xr-x@ 5 cmoullia  staff  160 Jul 14 12:47 ../
lrwxr-xr-x@ 1 cmoullia  staff   96 Jul 14 12:47 SKILL.md@ -> /Users/cmoullia/code/quarkus/fork-quarkus-skills/tests/skills/migrate-simple-with-mtool/SKILL.md

Question: Do we have to change within the SKILL.md file the link to the shared md file as currently it is defined like this ?

Load [../shared/migration-steps.md](../shared/migration-steps.md) for the annotation mapping tables (Step 2) and report template (Step 3).

@aureamunoz

[aureamunoz]

I tested both skills locally and got the same error on both:

I cannot reproduce the error. I deleted under tests folder => .opencode folder, launched the python script and here is the symlinks created which looks correct for me

❯ ls -la /Users/cmoullia/code/quarkus/fork-quarkus-skills/tests/.opencode/shared/
total 0
drwxr-xr-x@ 3 cmoullia  staff   96 Jul 14 12:47 ./
drwxr-xr-x@ 5 cmoullia  staff  160 Jul 14 12:47 ../
lrwxr-xr-x@ 1 cmoullia  staff   87 Jul 14 12:47 migration-steps.md@ -> /Users/cmoullia/code/quarkus/fork-quarkus-skills/tests/skills/shared/migration-steps.md

❯ ls -la /Users/cmoullia/code/quarkus/fork-quarkus-skills/tests/.opencode/skills/
total 0
drwxr-xr-x@ 3 cmoullia  staff   96 Jul 14 12:47 ./
drwxr-xr-x@ 5 cmoullia  staff  160 Jul 14 12:47 ../
lrwxr-xr-x@ 1 cmoullia  staff   96 Jul 14 12:47 SKILL.md@ -> /Users/cmoullia/code/quarkus/fork-quarkus-skills/tests/skills/migrate-simple-with-mtool/SKILL.md

Question: Do we have to change within the SKILL.md file the link to the shared md file as currently it is defined like this ?

Load [../shared/migration-steps.md](../shared/migration-steps.md) for the annotation mapping tables (Step 2) and report template (Step 3).

@aureamunoz

I keep hitting a "File not found" on ../shared/migration-steps.md, the LLM resolves the relative path inconsistently (sometimes .opencode/shared/, sometimes .opencode/skills/shared/). Fixed it locally by symlinking in both locations. Might be model/version dependent, which would explain why you don't see it.