Skip to content

FANet: A Feedback Attention Network for Improved Biomedical Image Segmentation [IEEE Transactions on Neural Networks and Learning Systems]

Notifications You must be signed in to change notification settings

nikhilroxtomar/FANet

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

23 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

FANet: A Feedback Attention Network for Improved Biomedical Image Segmentation

Authors: Nikhil Kumar Tomar, Debesh Jha, Michael A. Riegler, Håvard D. Johansen, Dag Johansen, Jens Rittscher, Pål Halvorsen and Sharib Ali
Research paper: https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=9741842

Abstract

The increase of available large clinical and exper- imental datasets has contributed to a substantial amount of important contributions in the area of biomedical image anal- ysis. Image segmentation, which is crucial for any quantitative analysis, has especially attracted attention. Recent hardware advancement has led to the success of deep learning approaches. However, although deep learning models are being trained on large datasets, existing methods do not use the information from different learning epochs effectively. In this work, we leverage the information of each training epoch to prune the prediction maps of the subsequent epochs. We propose a novel architecture called feedback attention network (FANet) that unifies the previous epoch mask with the feature map of the current training epoch. The previous epoch mask is then used to provide a hard attention to the learned feature maps at different convolutional layers. The network also allows to rectify the predictions in an iterative fashion during the test time. We show that our proposed feedback attention model provides a substantial improvement on most segmentation metrics tested on seven publicly available biomedical imaging datasets demonstrating the effectiveness of FANet.

Architecture

FANet Architecture

Dataset:

Qualitative results

qualitative result

Citation

Please cite our paper if you find it useful:

  @article{tomar2021fanet,
  title={Fanet: A feedback attention network for improved biomedical image segmentation},
  author={Tomar, Nikhil Kumar and Jha, Debesh and Riegler, Michael A and Johansen, H{\aa}vard D and Johansen, Dag and Rittscher, Jens and Halvorsen, P{\aa}l and Ali, Sharib},
  journal={arXiv preprint arXiv:2103.17235},
  year={2021}
}

Contact

Please contact nikhilroxtomar@gmail.com and debesh@simula.no for any further questions.

About

FANet: A Feedback Attention Network for Improved Biomedical Image Segmentation [IEEE Transactions on Neural Networks and Learning Systems]

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages