Skip to content

Latest commit

 

History

6 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Data & Channel efficient vision Transformer

Abstract

In order to improve the accuracy of the ViT architecture in image recognition tasks, this paper proposes a Transformer-based DNN applied to image classifier called Data and Channel efficient vision Transformer network by extracting image channel information. Furthermore, a method to avoid over-fitting is proposed called Entropy Increase for information of image Edge and Noise Lay-over for information of image Edge in this paper. Through a series of experiments, this paper compares the accuracy of the model with ViT and the traditional convolutional neural network structures in the classification data set, and evaluates the effectiveness of the two image preprocessing algorithms on the model and the convolutional neural network model. It turns out that the accuracy of this model is about 2% higher than other ViT-based DNNs.

Author

Yuyao Ge, Lizhe Chen

Architecture of Data and Channel efficient vision Transformer.

Diagram of DCT Transformer Encoder

Compared with other architecture

About

This project compares the accuracy of the model with ViT and the traditional convolutional neural network structures in the classification data set, and evaluates the effectiveness of the two image preprocessing algorithms on the model and the convolutional neural network model.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages