Skip to content

For the images captured with large camera rotation angles, the matching performance is much worse than that of SuperPoint. #69

Description

@haithink

I used the inference code,

CHECKPOINT=assets/models/silk/coco-rgb-aug.ckpt
TOPK=500
SIZE=640

./bin/silk-features -o -m pvgg-micro -c $CHECKPOINT -k $TOPK -d $OUT/features -s $SIZE $IMAGES/*.$IMAGES_EXTENSION
# generate image pairs to match
ls $OUT/features/*.pt | sort -V | xargs ./bin/generate-matches exhaustive -s > $OUT/matches.txt
# match keypoints from generated image pairs
./bin/silk-matching -o -m double-softmax -t 0.9 $OUT/matches.txt $OUT/matches/
# visualize matches
./bin/silk-viz image -o $OUT/viz $OUT/matches/*.pt

For images captured after a large rotation angle of the camera, the matching performance is much worse compared to SuperPoint.
For euroc dataset, matching result of silk model as follow:
image

matching result of superpoint model as follow:
image

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions