Residual UNet with Dual Attention—An ensemble residual UNet with dual attention for multi-modal and multi-class brain MRI segmentation

In this paper, we have proposed a variant of UNet for brain magnetic resonance imaging (MRI) segmentation. The proposed model, termed as Residual UNet with Dual Attention (RUDA), addresses the two significant challenges of UNet: extraction of the complex features with unclear boundaries and the problem of over-segmentation due to the redundancy caused by the skip connection usage. RUDA is constituted upon the residual blocks for extracting the complex structures. It Introduces attention into the skip connections to avoid redundancy and thereby the chance of over-segmentation. Our model segments brain MRI into white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF) regions, which are considered crucial informative substructures for diagnosing neurological disorders such as Alzheimer's. It has been implemented in an ensemble manner to accommodate the multi-sequence (T1-weighted, IR, and T2-FLAIR) scans. The empirical analysis shows that with an accuracy of 93.80%, RUDA outperforms the two baseline models: UNet (91.37%), ResUNet (91.44%).