APA
Click to copy
Roy, S., Koehler, G., Ulrich, C., Baumgartner, M., Petersen, J., Isensee, F., … Maier-Hein, K. (2023). MedNeXt: Transformer-driven Scaling of ConvNets for Medical Image Segmentation. International Conference on Medical Image Computing and Computer-Assisted Intervention.
Chicago/Turabian
Click to copy
Roy, Saikat, Gregor Koehler, Constantin Ulrich, M. Baumgartner, Jens Petersen, Fabian Isensee, P. Jaeger, and K. Maier-Hein. “MedNeXt: Transformer-Driven Scaling of ConvNets for Medical Image Segmentation.” International Conference on Medical Image Computing and Computer-Assisted Intervention (2023).
MLA
Click to copy
Roy, Saikat, et al. “MedNeXt: Transformer-Driven Scaling of ConvNets for Medical Image Segmentation.” International Conference on Medical Image Computing and Computer-Assisted Intervention, 2023.
BibTeX Click to copy
@article{saikat2023a,
title = {MedNeXt: Transformer-driven Scaling of ConvNets for Medical Image Segmentation},
year = {2023},
journal = {International Conference on Medical Image Computing and Computer-Assisted Intervention},
author = {Roy, Saikat and Koehler, Gregor and Ulrich, Constantin and Baumgartner, M. and Petersen, Jens and Isensee, Fabian and Jaeger, P. and Maier-Hein, K.}
}
There has been exploding interest in embracing Transformer-based architectures for medical image segmentation. However, the lack of large-scale annotated medical datasets make achieving performances equivalent to those in natural images challenging. Convolutional networks, in contrast, have higher inductive biases and consequently, are easily trainable to high performance. Recently, the ConvNeXt architecture attempted to modernize the standard ConvNet by mirroring Transformer blocks. In this work, we improve upon this to design a modernized and scalable convolutional architecture customized to challenges of data-scarce medical settings. We introduce MedNeXt, a Transformer-inspired large kernel segmentation network which introduces - 1) A fully ConvNeXt 3D Encoder-Decoder Network for medical image segmentation, 2) Residual ConvNeXt up and downsampling blocks to preserve semantic richness across scales, 3) A novel technique to iteratively increase kernel sizes by upsampling small kernel networks, to prevent performance saturation on limited medical data, 4) Compound scaling at multiple levels (depth, width, kernel size) of MedNeXt. This leads to state-of-the-art performance on 4 tasks on CT and MRI modalities and varying dataset sizes, representing a modernized deep architecture for medical image segmentation. Our code is made publicly available at: https://github.com/MIC-DKFZ/MedNeXt.
