Skip to content
TimeIsFuturePublic

About

Self-Attention has the expensive memory overhead and computation cost. Local-Global Semantics (LGS) module is proposed to alleviate it.

Topics

Resources

Stars

0 stars

Watchers

1 watching

Forks

Repository files navigation

Dt2_LGS

(a) The self-attention enables the pixel embedding interaction. The softmax correlation is computed between pixels. (b) Our LGS module learns modeling the local semantic aggregation and global semantic interaction. LGS contains a group convolution and an Efficient Global Semantic Attention (EGSA). EGSA formulates a general model for the global semantic interaction. The linear semantic correlation is computed between channels. LGS has the linear memory overhead and computation cost in term of the spatial resolution. The codes are built on the open-source toolkit detectron2.

Installation

See INSTALL.md.

Quick Start

See GETTING_STARTED.md,

Model Zoo

We provide a large set of baseline results for download in the Dt2_LGS Model Zoo.

License

Dt2_LGS is released under the Apache 2.0 license.

Citing Dt2_LGS

If you use Dt2_LGS in your research or wish to refer to the baseline results published in the Model Zoo, please use the following BibTeX entry.

@misc{wu2019detectron2,
  author =       {Yuxin Wu and Alexander Kirillov and Francisco Massa and
                  Wan-Yen Lo and Ross Girshick},
  title =        {Detectron2},
  howpublished = {\url{https://github.com/facebookresearch/detectron2}},
  year =         {2019}
}

@article{Li2024LGSNetLG,
  author={Li, Yang and Jiao, Licheng and Liu, Xu and Liu, Fang and Li, Lingling and Chen, Puhua},
  journal={IEEE Transactions on Multimedia}, 
  title={LGSNet: Local-Global Semantics Learning Object Detection}, 
  year={2024},
  pages={1-12},
  doi={10.1109/TMM.2024.3521850}
}

About

Self-Attention has the expensive memory overhead and computation cost. Local-Global Semantics (LGS) module is proposed to alleviate it.

Topics

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Used by

Contributors

Languages