Skip to content

Figure3-4-5 Naive/IGS/FGS performance fgs - #113

Open
zacharopoulou wants to merge 18 commits into
figure2-coverage-scriptfrom
figure3-performance-fgs
Open

Figure3-4-5 Naive/IGS/FGS performance fgs#113
zacharopoulou wants to merge 18 commits into
figure2-coverage-scriptfrom
figure3-performance-fgs

Conversation

@zacharopoulou

@zacharopoulou zacharopoulou commented Jul 16, 2026

Copy link
Copy Markdown
Contributor

Summary

This PR adds manuscript figure generation for performance evaluations across three miRNA-gene pair universes:

Figure Evaluation Universe of miRNA-gene pairs
Figure 3 Naive / algorithm-specific evaluation Each algorithm is evaluated only on the ground-truth pairs for
which that algorithm supplied a score. Therefore, every algorithm may be evaluated on a different gene/pair set.
Figure 4 IPS - Intersection Pair Set Only ground-truth miRNA-gene pairs for which **all evaluated
algorithms supplied a prediction score**. This is one shared, restricted universe used for every algorithm.
Figure 5 FPS - Full Pair Set Every miRNA-gene pair in the complete benchmark ground-truth dataset. When an
algorithm did not score a pair, it receives the defined zero-equivalent score.

The branch keeps the generated figures and tables out of git and documents the commands needed to regenerate them.

Changes

  • Adds separate figure entry points:
    • scripts/figure3_performance_naive.py
    • scripts/figure4_performance_ips.py
    • scripts/figure5_performance_fps.py
  • Adds shared performance plotting/statistics helpers:
    • scripts/figure_performance_common.py
  • Generates each panel separately before assembling combined figures.
  • Uses box plots with per-dataset dots for metric distributions.
  • Adds APS and Spearman R2 leaderboard panels.
  • Keeps random baseline in Figures 4 and 5.

@zacharopoulou
zacharopoulou force-pushed the figure2-coverage-script branch from 47b6a7d to b99ed40 Compare July 19, 2026 20:16
@zacharopoulou
zacharopoulou force-pushed the figure3-performance-fgs branch 3 times, most recently from 4376485 to 7608a36 Compare July 20, 2026 11:28
@zacharopoulou zacharopoulou changed the title Figure3 performance fgs Figure3-4-5 Naive/IGS/FGS performance fgs Jul 20, 2026
@zacharopoulou
zacharopoulou marked this pull request as ready for review July 20, 2026 16:07
@zacharopoulou
zacharopoulou force-pushed the figure2-coverage-script branch from 6ead345 to eb079f4 Compare July 23, 2026 12:55
@zacharopoulou
zacharopoulou force-pushed the figure3-performance-fgs branch from 38bfb50 to 46e734c Compare July 23, 2026 16:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant