AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Powered by AMiner. Clicking this button will take you away from SciOpen.
Home Big Data Mining and Analytics Article
PDF (875.1 KB)
Cite
EndNote(RIS) BibTeX
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Open Access

Applications of Deep Learning to MRI Images: A Survey

School of Information Science and Engineering, Central South University, Changsha 410083, China.
Department of Computer Science, Georgia State University, Atlanta, GA30302, USA.
Show Author Information

Abstract

Deep learning provides exciting solutions in many fields, such as image analysis, natural language processing, and expert system, and is seen as a key method for various future applications. On account of its non-invasive and good soft tissue contrast, in recent years, Magnetic Resonance Imaging (MRI) has been attracting increasing attention. With the development of deep learning, many innovative deep learning methods have been proposed to improve MRI image processing and analysis performance. The purpose of this article is to provide a comprehensive overview of deep learning-based MRI image processing and analysis. First, a brief introduction of deep learning and imaging modalities of MRI images is given. Then, common deep learning architectures are introduced. Next, deep learning applications of MRI images, such as image detection, image registration, image segmentation, and image classification are discussed. Subsequently, the advantages and weaknesses of several common tools are discussed, and several deep learning tools in the applications of MRI images are presented. Finally, an objective assessment of deep learning in MRI applications is presented, and future developments and trends with regard to deep learning for MRI images are addressed.

Keywords

magnetic resonance imagingdeep learningimage detectionimage registrationimage segmentationimage classification

References

[1]
Brooks R. A., Intelligence without representation, Artif. Intell., vol. 47, nos. 1–3, pp. 139-159, 1991.
Crossref Google Scholar
[2]
Nilsson N. J., Principles of Artificial Intelligence. Los Altos, CA, USA: Morgan Kaufmann, 2014.
[3]
Cohen P. R. and Feigenbaum E. A., The Handbook of Artificial Intelligence. Los Altos, CA, USA: Butterworth-Heinemann, 2014.
[4]
Baldi P. and Brunak S., Bioinformatics: The Machine Learning Approach. Cambridge, MT, USA: MIT Press, 2001.
[5]
Bishop C., Pattern Recognition and Machine Learning. Springer-Verlag, 2006.
[6]
Michalski R. S., Carbonell J. G., and Mitchell T. M., Machine Learning: An Artificial Intelligence Approach. Berlin, Germany: Springer Science & Business Media, 2013.
[7]
Liu J., Li M., Lan W., Wu F. X., Pan Y., and Wang J. X., Classification of Alzheimer’s disease using whole brain hierarchical network, IEEE/ACM Trans. Comput. Biol. Bioinform., .
Crossref Google Scholar
[8]
Liu J., Li M., Pan Y., Wu F. X., Chen X. G., and Wang J. X., Classification of schizophrenia based on individual hierarchical brain networks constructed from structural MRI images, IEEE Trans. NanoBiosci., vol. 16, no. 7, pp. 600-608, 2017.
Crossref Google Scholar
[9]
Liu J., Wang J. X., Hu B., Wu F. X., and Pan Y., Alzheimer’s disease classification based on individual hierarchical networks constructed with 3-D texture features, IEEE Trans. NanoBiosci., vol. 16, no. 6, pp. 428-437, 2017.
Crossref Google Scholar
[10]
Lan W., Li M., Zhao K. J., Liu J., Wu F. X., Pan Y., and Wang J. X., LDAP: A web server for LncRNA-disease association prediction, Bioinformatics, vol. 33, no. 3, pp. 458-460, 2017.
Crossref Google Scholar
[11]
Lan W., Wang J. X., Li M., Liu J., Li Y. H., Wu F. X., and Pan Y., Predicting drug–target interaction using positive-unlabeled learning, Neurocomputing, vol. 206, pp. 50-57, 2016.
Crossref Google Scholar
[12]
Lan W., Wang J. X., Li M., Liu J., Wu F. X., and Pan Y., Predicting microRNA-disease associations based on improved microRNA and disease similarities, IEEE/ACM Trans. Comput. Biol. Bioinform., .
Crossref Google Scholar
[13]
Bradski G. R. and Kaehler A., Learning OpenCV: Computer Vision with the OpenCV Library. Sebastopol, CA, USA: O’Reilly Media, Inc., 2008.
[14]
Vedaldi A. and Fulkerson B., Vlfeat: An open and portable library of computer vision algorithms, in Proc.18th ACM Int. Conf. Multimedia, Firenze, Italy, 2010, pp. 1469-1472.
Crossref
[15]
Cipolla R., Battiato S., and Farinella G. M., Machine Learning for Computer Vision. Springer, 2013.
Crossref
[16]
Yegnanarayana B., Artificial Neural Networks. New Delhi, India: PHI Learning Pvt. Ltd., 2009.
[17]
Bengio Y., Lamblin P., Popovici D., and Larochelle H., Greedy layer-wise training of deep networks, in Advances in Neural Information Processing Systems, Vancouver, Canada, 2007, p. 153.
[18]
Bengio Y., Learning deep architectures for AI, Found. Trends Mach. Learn., vol. 2, no. 1, pp. 1-127, 2009.
Crossref Google Scholar
[19]
Erhan D., Bengio Y., Courville A., Manzagol P. A., Vincent P., and Bengio S., Why does unsupervised pre-training help deep learning?, J. Mach. Learn. Res., vol. 11, pp. 625-660, 2010.
Google Scholar
[20]
Glorot X., Bordes A., and Bengio Y., Domain adaptation for large-scale sentiment classification: A deep learning approach, in Proc. 28th Int. Conf. Machine Learning, Bellevue, WA, USA, 2011, pp. 513-520.
[21]
Le Q. V., Ngiam J., Coates A., Lahiri A., Prochnow B., and Ng A. Y., On optimization methods for deep learning, in Proc. 28th Int. Conf. Machine Learning, Bellevue, WA, USA, 2011, pp. 265-272.
[22]
Bengio Y., Courville A., and Vincent P., Representation learning: A review and new perspectives, IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 8, pp. 1798-1828, 2013.
Crossref Google Scholar
[23]
LeCun Y., Bengio Y., and Hinton G., Deep learning, Nature, vol. 521, no. 7553, pp. 436-444, 2015.
Crossref Google Scholar
[24]
Yu Z., Yu N., Pan Y., and Li T. R., A novel deep learning network architecture with cross-layer neurons, in Proc. 2016 IEEE Int. Conf. Big Data and Cloud Computing (BDCloud), Social Computing and Networking (SocialCom), Sustainable Computing and Communications (SustainCom)(BDCloud-SocialCom-SustainCom), Atlanta, GA, USA, 2016, pp. 111-117.
Crossref
[25]
Greenspan H., van Ginneken B., and Summers R. M., Guest editorial deep learning in medical imaging: Overview and future promise of an exciting new technique, IEEE Trans. Med. Imaging, vol. 35, no. 5, pp. 1153-1159, 2016.
Crossref Google Scholar
[26]
Yu N., Yu Z., and Pan Y., A deep learning method for lincRNA identification using auto-encoder algorithm, in Proc. 6th Int. Conf. Computational Advances in Bio and Medical Sciences (ICCABS), Atlanta, GA, USA, 2016, 2016, p. 1.
Crossref
[27]
Dean J., Corrado G. S., Monga R., Chen K., Devin M., Le Q. V., Mao M. Z., Ranzato M., Senior A., Tucker P., et al., Large scale distributed deep networks, in Proc. 25th Int. Conf. Neural Information Processing Systems, Lake Tahoe, NV, USA, 2012, pp. 1223-1231.
[28]
Liu J., Li M., Wang J. X., Wu F. X., Liu T. M., and Pan Y., A survey of MRI-based brain tumor segmentation methods, Tsinghua Sci. Technol., vol. 19, no. 6, pp. 578-595, 2014.
Crossref Google Scholar
[29]
Liu J., Wang J. X., Tang Z. J., Hu B., Wu F. X., and Pan Y., Improving Alzheimeres disease classification by combining multiple measures, IEEE/ACM Trans. Comput. Biol. Bioinform., .
Crossref Google Scholar
[30]
Liu J., Li M., Pan Y., Lan W., Zheng R. Q., Wu F. X., and Wang J. X., Complex brain network analysis and its applications to brain disorders: A survey, Complexity, vol. 2017, p. 8362741, 2017.
Crossref Google Scholar
[31]
Schmidhuber J., Deep learning in neural networks: An overview, Neural Netw., vol. 61, pp. 85-117, 2015.
Crossref Google Scholar
[32]
Goodfellow I., Bengio Y., and Courville A., Deep Learning. Cambridge, MA, USA: MIT Press, 2016.
[33]
Bourlard H. and Kamp Y., Auto-association by multilayer perceptrons and singular value decomposition, Biol. Cybern., vol. 59, nos. 4&5, pp. 291-294, 1988.
Crossref Google Scholar
[34]
Hinton G. E. and Zemel R. S., Autoencoders, minimum description length, and Helmholtz free energy, in Proc. 6th Int. Conf. Neural Information Processing Systems, Denver, CO, USA, 1994, p. 3.
[35]
Alain G. and Bengio Y., What regularized auto-encoders learn from the data-generating distribution, J. Mach. Learn. Res., vol. 15, no. 1, pp. 3563-3593, 2014.
Crossref Google Scholar
[36]
Ranzato M. A., Poultney C., Chopra S., and LeCun Y., Efficient learning of sparse representations with an energy-based model, in Proc. 20th Annual Conf. Neural Information Processing Systems, Vancouver, Canada, 2006, pp. 1137-1144.
[37]
Ranzato M. A., Boureau Y. L., and LeCun Y., Sparse feature learning for deep belief networks, in Proc. 20th Int. Conf. Neural Information Processing Systems, Vancouver, Canada, 2008, pp. 1185-1192.
[38]
Vincent P., Larochelle H., Bengio Y., and Manzagol P. A., Extracting and composing robust features with denoising autoencoders, in Proc. 25th Int. Conf. Machine Learning, Helsinki, Finland, 2008, pp. 1096-1103.
Crossref
[39]
Vincent P., Larochelle H., Lajoie I., Bengio Y., and Manzagol P. A., Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion, J. Mach. Learn. Res., vol. 11, pp. 3371-3408, 2010.
Google Scholar
[40]
Bengio Y., Yao L., Alain G., and Vincent P., Generalized denoising auto-encoders as generative models, in Proc. 26th Int. Conf. Neural Information Processing Systems, Lake Tahoe, NV, USA, 2013, pp. 899-907.
[41]
Rifai S., Vincent P., Muller X., Glorot X., and Bengio Y., Contractive auto-encoders: Explicit invariance during feature extraction, in Proc. 28th Int. Conf. Machine Learning (ICML-11), Bellevue, WA, USA, 2011, pp. 833-840.
Crossref
[42]
Rifai S., Mesnil G., Vincent P., Muller X., Bengio Y., Dauphin Y., and Glorot X., Higher order contractive auto-encoder, in Joint European Conference on Machine Learning and Knowledge Discovery in Databases, Athens, Greece, 2011, pp. 645-660.
Crossref
[43]
Golub G. H. and van Loan C. F., Matrix Computations. Baltimore, MD, USA: Johns Hopkins University Press, 2012.
[44]
Masci J., Meier U., Ciresan D., and Schmidhuber J., Stacked convolutional auto-encoders for hierarchical feature extraction, in Proc. 21th Int. Conf. Artificial Neural Networks, Espoo, Finland, 2011, pp. 52-59.
Crossref
[45]
Fahlman S. E., Hinton G. E., and Sejnowski T. J., Massively parallel architectures for AI: Netl, thistle, and Boltzmann machines, in Proc. 3rd AAAI Conf. Artificial Intelligence, Washington, DC, USA, 1983.
[46]
Hinton G. E., Sejnowski T. J., and Ackley D. H., Boltzmann machines: Constraint satisfaction networks that learn, Technical Report CMU-CS-84-119, Carnegie-Mellon University, Pittsburgh, PA, USA, 1984.
[47]
Ackley D. H., Hinton G. E., and Sejnowski T. J., A learning algorithm for Boltzmann machines, Cogn. Sci., vol. 9, no. 1, pp. 147-169, 1985.
Crossref Google Scholar
[48]
Hinton G. E. and Sejnowski T. J., Learning and relearning in Boltzmann machines, in Parallel Distributed Processing: Explorations in the Microstructure of Cognition, D. E. Rumelhart and J. L. McClelland, eds. Cambridge, MA, USA: MIT Press, 1986, pp. 282-317.
Crossref
[49]
Hinton G. E., A practical guide to training restricted Boltzmann machines, in Neural Networks: Tricks of the Trade, Montavon G., Orr G. B., and Müller K. R., eds. Springer, 2012, pp. 599-619.
Crossref
[50]
Hjelm R. D., Calhoun V. D., Salakhutdinov R., Allen E. A., Adali T., and Plis S. M., Restricted Boltzmann machines for neuroimaging: An application in identifying intrinsic networks, NeuroImage, vol. 96, pp. 245-260, 2014.
Crossref Google Scholar
[51]
Hinton G. E., Osindero S., and Teh Y. W., A fast learning algorithm for deep belief nets, Neural Comput., vol. 18, no. 7, pp. 1527-1554, 2006.
Crossref Google Scholar
[52]
Hinton G. E., Learning multiple layers of representation, Trends Cogn. Sci., vol. 11, no. 10, pp. 428-434, 2007.
Crossref Google Scholar
[53]
Lee H., Ekanadham C., and Ng A. Y., Sparse deep belief net model for visual area V2, in Proc. 21st Conf. Neural Information Processing Systems, Vancouver, Canada, 2007, pp. 873-880.
Crossref
[54]
Lee H., Grosse R., Ranganath R., and Ng A. Y., Unsupervised learning of hierarchical representations with convolutional deep belief networks, Commun. ACM, vol. 54, no. 10, pp. 95-103, 2011.
Crossref Google Scholar
[55]
LeCun Y. and Bengio Y., Convolutional networks for images, speech, and time-series, in The Handbook of Brain Theory and Neural Networks, Arbib M. A., ed. Cambridge, MA, USA: MIT Press, 1995,.
[56]
Lee H., Grosse R., Ranganath R., and Ng A. Y., Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations, in Proc. 26th Annual Int. Conf. Machine Learning, Montreal, Canada, 2009, pp. 609-616.
Crossref
[57]
LeCun Y., Kavukcuoglu K., and Farabet C., Convolutional networks and applications in vision. in Proc. 2010 IEEE Int. Symposium on Circuits and Systems (ISCAS), Paris, France, 2010, pp. 253-256.
Crossref
[58]
Springenberg J. T., Dosovitskiy A., Brox T., and Riedmiller M., Striving for simplicity: The all convolutional net, arXiv preprint arXiv: 1412.6806, 2014.
Google Scholar
[59]
LeCun Y., Bottou L., Bengio Y., and Haffner P., Gradient-based learning applied to document recognition, Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, 1998.
Crossref
[60]
Simard P. Y., Steinkraus D., and Platt J. C., Best practices for convolutional neural networks applied to visual document analysis. in Proc. 7th Int. Conf. Document Analysis and Recognition, Edinburgh, UK, 2003, pp. 958-962.
[61]
Krizhevsky A., Sutskever I., and Hinton G. E., ImageNet classification with deep convolutional neural networks, in Proc. 25th Int. Conf. Neural Information Processing Systems, Lake Tahoe, NV, USA, 2012, pp. 1097-1105.
[62]
Simonyan K. and Zisserman A., Very deep convolutional networks for large-scale image recognition, arXiv preprint arXiv: 1409.1556, 2014.
Google Scholar
[63]
He K. M., Zhang X. Y., Ren S. Q., and Sun J., Deep residual learning for image recognition, arXiv preprint arXiv: 1512.03385, 2015.
Google Scholar
[64]
He K. M., Zhang X. Y., Ren S. Q., and Sun J., Identity mappings in deep residual networks, arXiv preprint arXiv: 1603.05027, 2016.
Google Scholar
[65]
Zeiler M. D. and Fergus R., Visualizing and understanding convolutional networks, in Proc. 13th European Conf. Computer Vision, Zurich, Switzerland, 2014, pp. 818-833.
Crossref
[66]
Szegedy C., Liu W., Jia Y. Q., Sermanet P., Reed S., Anguelov D., Erhan D., Vanhoucke V., and Rabinovich A., Going deeper with convolutions, in Proc. 2015 IEEE Conf. Computer Vision and Pattern Recognition, Boston, MA, USA, 2015, pp. 1-9.
Crossref
[67]
Szegedy C., Ioffe S., Vanhoucke V., and Alemi A., Inception-v4, inception-ResNet and the impact of residual connections on learning, arXiv preprint arXiv: 1602.07261, 2016.
Google Scholar
[68]
Szegedy C., Vanhoucke V., Ioffe S., Shlens J., and Wojna Z., Rethinking the inception architecture for computer vision, in Proc. 2016 IEEE Conf. Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 2016, pp. 2818-2826.
Crossref
[69]
Shin H. C., Orton M. R., Collins D. J., Doran S. J., and Leach M. O., Stacked autoencoders for unsupervised feature learning and multiple organ detection in a pilot study using 4D patient data, IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 8, pp. 1930-1943, 2013.
Crossref Google Scholar
[70]
Ghafoorian M., Karssemeijer N., Heskes T., Bergkamp M., Wissink J., Obels J., Keizer K., de Leeuw F. E., van Ginneken B., Marchiori E., et al., Deep multi-scale location-aware 3D convolutional neural networks for automated detection of lacunes of presumed vascular origin, arXiv preprint arXiv: 1610.07442, 2016.
Google Scholar
[71]
Dou Q., Chen H., Yu L. Q., Zhao L., Qin J., Wang D. F., Mok V. C., Shi L., and Heng P. A., Automatic detection of cerebral microbleeds from MR images via 3D convolutional neural networks, IEEE Trans. Med. Imaging, vol. 35, no. 5, pp. 1182-1195, 2016.
Crossref Google Scholar
[72]
Zitová B. and Flusser J., Image registration methods: A survey, Image Vis. Comput., vol. 21, no. 11, pp. 977-1000, 2003.
Crossref Google Scholar
[73]
Wu G. R., Kim M., Wang Q., Gao Y. Z., Liao S., and Shen D. G., Unsupervised deep feature learning for deformable registration of MR brain images, in Proc. 16th Int. Conf. Medical Image Computing and Computer-Assisted Intervention, Nagoya, Japan, 2013, pp. 649-656.
Crossref
[74]
Wu G. R., Kim M., Wang Q., Munsell B. C., and Shen D. G., Scalable high-performance image registration framework by unsupervised deep feature representations learning, IEEE Trans. Biomed. Eng., vol. 63, no. 7, pp. 1505-1516, 2016.
Crossref Google Scholar
[75]
Stollenga M. F., Byeon W., Liwicki M., and Schmidhuber J., Parallel multi-dimensional LSTM, with application to fast biomedical volumetric image segmentation, in Proc. 28th textit Int. Conf. Neural Information Processing Systems, Montreal, Canada, 2015, pp. 2998-3006.
[76]
Zhang W. L., Li R. J., Deng H. T., Wang L., Lin W. L., Ji S. W., and Shen D. G., Deep convolutional neural networks for multi-modality isointense infant brain image segmentation, NeuroImage, vol. 108, pp. 214-224, 2015.
Crossref Google Scholar
[77]
Moeskops P., Viergever M. A., Mendrik A. M., de Vries L. S., Benders M. J. N. L., and Išgum I., Automatic segmentation of MR brain images with a convolutional neural network, IEEE Trans. Med. Imaging, vol. 35, no. 5, pp. 1252-1261, 2016.
Crossref Google Scholar
[78]
Kleesiek J., Urban G., Hubert A., Schwarz D., Maier-Hein K., Bendszus M., and Biller A., Deep MRI brain extraction: A 3D convolutional neural network for skull stripping, NeuroImage, vol. 129, pp. 460-469, 2016.
Crossref Google Scholar
[79]
Zikic D., Ioannou Y., Criminisi A., and Brown M., Segmentation of brain tumor tissues with convolutional neural networks, Proceedings MICCAI Workshop on Multimodal Brain Tumor Segmentation Challenge, Boston, MA, USA, 2014, pp. 36-39.
[80]
Urban G., Bendszus M., Hamprecht F., and Kleesiek J., Multi-modal brain tumor segmentation using deep convolutional neural networks, in Proc. MICCAI BraTS (Brain Tumor Segmentation) Challenge, 2014, pp. 31-35.
[81]
Lyksborg M., Puonti O., Agn M., and Larsen R., An ensemble of 2D convolutional neural networks for tumor segmentation, in Proc. 19th Scandinavian Conf. Image Analysis, Copenhagen, Denmark, 2015, pp. 201-211.
Crossref
[82]
Dvorak P. and Menze B. H., Structured prediction with convolutional neural networks for multimodal brain tumor segmentation, in Proc. Multimodal Brain Tumor Image Segmentation Challenge, Munich, Germany, 2015, pp. 13-24.
[83]
Pereira S., Pinto A., Alves V., and Silva C. A., Brain tumor segmentation using convolutional neural networks in mri images, IEEE Trans. Med. Imaging, vol. 35, no. 5, pp. 1240-1251, 2016.
Crossref Google Scholar
[84]
Havaei M., Davy A., Warde-Farley D., Biard A., Courville A., Bengio Y., Pal C., Jodoin P. M., and Larochelle H., Brain tumor segmentation with deep neural networks, Med. Image Anal., vol. 35, pp. 18-31, 2017.
Crossref Google Scholar
[85]
Zhen X. T., Wang Z. J., Islam A., Bhaduri M., Chan I., and Li S., Multi-scale deep networks and regression forests for direct bi-ventricular volume estimation, Med. Image Anal., vol. 30, pp. 120-129, 2016.
Crossref Google Scholar
[86]
Avendi M. R., Kheradvar A., and Jafarkhani H., A combined deep-learning and deformable-model approach to fully automatic segmentation of the left ventricle in cardiac MRI, Med. Image Anal., vol. 30, pp. 108-119, 2016.
Crossref Google Scholar
[87]
Ngo T. A., Lu Z., and Carneiro G., Combining deep learning and level set for the automated segmentation of the left ventricle of the heart from cardiac cine magnetic resonance, Med. Image Anal., vol. 35, pp. 159-171, 2017.
Crossref Google Scholar
[88]
Yoo Y., Brosch T., Traboulsee A., Li D. K. B., and Tam R., Deep learning of image features from unlabeled data for multiple sclerosis lesion segmentation, in Proc. 5th Int. Workshop on Machine Learning in Medical Imaging, Boston, MA, USA, 2014, pp. 117-124.
Crossref
[89]
Brosch T., Tang L. Y. W., Yoo Y., Li D. K. B., Traboulsee A., and Tam R., Deep 3D convolutional encoder networks with shortcuts for multiscale feature integration applied to multiple sclerosis lesion segmentation, IEEE Trans. Med. Imaging, vol. 35, no. 5, pp. 1229-1239, 2016.
Crossref Google Scholar
[90]
Guo Y. R., Gao Y. Z., and Shen D. G., Deformable mr prostate segmentation via deep feature learning and sparse patch matching, IEEE Trans. Med. Imaging, vol. 35, no. 4, pp. 1077-1089, 2016.
Crossref Google Scholar
[91]
Choi H. and Jin K. H., Fast and robust segmentation of the striatum using deep convolutional neural networks,J. Neurosci. Methods, vol. 274, pp. 146-153, 2016.
Crossref Google Scholar
[92]
Prasoon A., Petersen K., Igel C., Lauze F., Dam E., and Nielsen M., Deep feature learning for knee cartilage segmentation using a triplanar convolutional neural network, in Proc. 16th Int. Conf. Medical Image Computing and Computer-Assisted Intervention, Nagoya, Japan, 2013, pp. 246-253.
Crossref
[93]
Jiang F., Li H. T., Hou X. H., Sheng B., Shen R. M., Liu X. Y., Jia W. P., Li P., and Fang R. G., Abdominal adipose tissues extraction using multi-scale deep neural network, Neurocomputing, vol. 229, pp. 23-33, 2017.
Crossref Google Scholar
[94]
Mansoor A., Cerrolaza J. J., Idrees R., Biggs E., Alsharid M. A., Avery R. A., and Linguraru M. G., Deep learning guided partitioned shape model for anterior visual pathway segmentation, IEEE Trans. Med. Imaging, vol. 35, no. 8, pp. 1856-1865, 2016.
Crossref Google Scholar
[95]
Suk H. I., Lee S. W., and Shen D. G., Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis, NeuroImage, vol. 101, pp. 569-582, 2014.
Crossref Google Scholar
[96]
Koyamada S., Shikauchi Y., Nakae K., Koyama M., and Ishii S., Deep learning of fMRI big data: A novel approach to subject-transfer decoding, arXiv preprint arXiv: 1502.00093, 2015.
Google Scholar
[97]
Pinaya W. H., Gadelha A., Doyle O. M., Noto C., Zugman A., Cordeiro Q., Jackowski A. P., Bressan R. A., and Sato J. R., Using deep belief network modelling to characterize differences in brain morphometry in schizophrenia, Sci. Rep., vol. 6, p. 38897, 2016.
Crossref Google Scholar
[98]
Liu F. Y. and Shen C. H., Learning deep convolutional features for MRI based Alzheimer’s disease classification, arXiv preprint arXiv: 1404.3366, 2014.
Google Scholar
[99]
Liu S. Q., Liu S. D., Cai W. D., Pujol S., Kikinis R., and Feng D. G., Early diagnosis of Alzheimer’s disease with deep learning, in Proc. 2014 IEEE 11th Int. Symposium on Biomedical Imaging (ISBI), Beijing, China, 2014, pp. 1015-1018.
Crossref
[100]
Liu S. Q., Liu S. D., Cai W. D., Pujol S., Kikinis R., and Feng D. D., Multi-phase feature representation learning for neurodegenerative disease diagnosis, in Proc. 1st Australasian Conf. Artificial Life and Computational Intelligence, Newcastle, Australia, 2015, pp. 350-359.
Crossref
[101]
Li F., Tran L., Thung K. H., Ji S. W., Shen D. G., and Li J., A robust deep model for improved classification of ad/mci patients, IEEE J. Biomed. Health Inform., vol. 19, no. 5, pp. 1610-1616, 2015.
Crossref Google Scholar
[102]
Payan A. and Montana G., Predicting alzheimer’s disease: A neuroimaging study with 3D convolutional neural networks, arXiv preprint arXiv: 1502.02506, 2015.
Google Scholar
[103]
Ithapu V. K., Singh V., Okonkwo O. C., Chappell R. J., Dowling N. M., and Johnson S. C., Imaging-based enrichment criteria using deep learning algorithms for efficient clinical trials in mild cognitive impairment, Alzheimers Dement., vol. 11, no. 12, pp. 1489-1499, 2015.
Crossref Google Scholar
[104]
Suk H. I., Lee S. W., and Shen D. G., Latent feature representation with stacked auto-encoder for AD/MCI diagnosis, Brain Struct. Funct., vol. 220, no. 2, pp. 841-859, 2015.
Crossref Google Scholar
[105]
Sarraf S., Anderson J., and Tofighi G., DeepAD: Alzheimer’s disease classification via deep convolutional neural networks using mri and fMRI, bioRxiv, .
Crossref
[106]
Hosseini-Asl E., Keynton R., and El-Baz A., Alzheimer’s disease diagnostics by adaptation of 3D convolutional network, in Proc. 2016 IEEE Int. Conf. Image Processing (ICIP), Phoenix, AZ, USA, 2016, pp. 126-130.
Crossref
[107]
Tandon R., Nasrallah H. A., and Keshavan M. S., Schizophrenia, “just the facts” 4. clinical features and conceptualization, Schizophr. Res., vol. 110, nos. 1–3, pp. 1-23, 2009.
Crossref Google Scholar
[108]
Keshavan M. S., Nasrallah H. A., and Tandon R., Schizophrenia, “just the facts” 6. moving ahead with the schizophrenia concept: from the elephant to the mouse, Schizophr. Res., vol. 127, nos. 1–3, pp. 3-13, 2011.
Crossref Google Scholar
[109]
Plis S. M., Hjelm D. R., Salakhutdinov R., and Calhoun V. D., Deep learning for neuroimaging: A validation study, arXiv preprint arXiv: 1312.5847, 2013.
Google Scholar
[110]
Kim J., Calhoun V. D., Shim E., and Lee J. H., Deep neural network with weight sparsity control and pre-training extracts hierarchical features and enhances classification performance: Evidence from whole-brain resting-state functional connectivity patterns of schizophrenia, NeuroImage, vol. 124, pp. 127-146, 2016.
Crossref Google Scholar
[111]
Qi J. and Tejedor J., Deep multi-view representation learning for multi-modal features of the schizophrenia and schizo-affective disorder, in Proc. 2016 IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), Shanghai, China, 2016, pp. 952-956.
Crossref
[112]
Shibata K., Watanabe T., Sasaki Y., and Kawato M., Perceptual learning incepted by decoded fMRI neurofeedback without stimulus presentation, Science, vol. 334, no. 6061, pp. 1413-1415, 2011.
Crossref Google Scholar
[113]
Horikawa T., Tamaki M., Miyawaki Y., and Kamitani Y., Neural decoding of visual imagery during sleep, Science, vol. 340, no. 6132, pp. 639-642, 2013.
Crossref Google Scholar
[114]
Hatakeyama Y., Yoshida S., Kataoka H., and Okuhara Y., Multi-voxel pattern analysis of fMRI based on deep learning methods, in Soft Computing in Big Data Processing, K. Lee, S. J. Park, and J. H. Lee, eds. Springer, 2014, pp. 29-38.
Crossref
[115]
Firat O., Oztekin L., and Vural F. T. Y., Deep learning for brain decoding, in Proc. 2014 IEEE Int. Conf. Image Processing (ICIP), Paris, France, 2014, pp. 2784-2788.
Crossref
[116]
Jang H., Plis S. M., Calhoun V. D., and Lee J. H., Task-specific feature extraction and classification of fMRI volumes using a deep neural network initialized with a deep belief network: Evaluation using sensorimotor tasks, NeuroImage, vol. 145, pp. 314-328, 2017.
Crossref Google Scholar
[117]
Hinton G. E., Srivastava N., Krizhevsky A., Sutskever I., and Salakhutdinov R. R., Improving neural networks by preventing co-adaptation of feature detectors, arXiv preprint arXiv: 1207.0580, 2012.
Google Scholar
[118]
Koyamada S., Koyama M., Nakae K., and Ishii S., Principal sensitivity analysis, in Proc. 19th Pacific-Asia Conf. Knowledge Discovery and Data Mining, Ho Chi Minh City, Vietnam, 2015, pp. 621-632.
Crossref
[119]
Kuang D. P. and He L. H., Classification on ADHD with deep learning, in Proc. 2014 Int. Conf. Cloud Computing and Big Data (CCBD), Wuhan, China, 2014, pp. 27-32.
Crossref
[120]
Han X. B., Zhong Y. F., He L. F., Yu P. S., and Zhang L. P., The unsupervised hierarchical convolutional sparse auto-encoder for neuroimaging data classification, in Proc. 8th Int. Conf. Brain Informatics and Health, London, UK: 2015, pp. 156-166.
Crossref
[121]
Jang H. and Lee J. H., Deep neural network for age prediction using resting-state fMRI data, in The Organization for Human Brain Mapping (OHBM) 2016 Annual Meeting, 2016.
[122]
Kawahara J., Brown C. J., Miller S. P., Booth B. G., Chau V., Grunau R. E., Zwicker J. G., and Hamarneh G., BrainNetCNN: Convolutional neural networks for brain networks towards predicting neurodevelopment, NeuroImage, vol. 146, pp. 1038-1049, 2016.
Crossref Google Scholar
[123]
Cole J. H., Poudel R. P. K., Tsagkrasoulis D., Caan M. W. A., Steves C., Spector T. D., and Montana G., Predicting brain age with deep learning from raw imaging data results in a reliable and heritable biomarker, arXiv preprint arXiv: 1612.02572, 2016.
Google Scholar
[124]
Schmah T., Hinton G. E., Zemel R. S., Small S. L., and Strother S., Generative versus discriminative training of rbms for classification of fMRI images, in Proc. 21st Int. Conf. Neural Information Processing Systems, Vancouver, Canada, 2008, pp. 1409-1416.
[125]
Kim H. C. and Lee J. H., Deep learning to predict the emotional response using functional MRI data, in The Organization for Human Brain Mapping (OHBM) 2016 Annual Meeting, 2016.
[126]
Yang Z., Zhong S. H., Carass A., Ying S. H., and Prince J. L., Deep learning for cerebellar ataxia classification and functional score regression, in Proc. 5th Int. Workshop on Machine Learning in Medical Imaging, Boston, MA, USA, 2014, pp. 68-76.
Crossref
[127]
Jia Y., Shelhamer E., Donahue J., Karayev S., Long J., Girshick R., Guadarrama S., and Darrell T., Caffe: Convolutional architecture for fast feature embedding, in Proc. 22nd ACM Int. Conf. Multimedia, Orlando, FL, USA, 2014, pp. 675-678.
Crossref
[128]
Palm R. B., Prediction as a candidate for learning deep hierarchical models of data, Master’s thesis, Technical University of Denmark, Denmark, 2012.
[129]
Collobert R., Kavukcuoglu K., and Farabet C., Torch7: A matlab-like environment for machine learning, in BigLearn, NIPS Workshop, No. EPFL-CONF-192376, 2011.
[130]
Al-Rfou R., Alain G., Almahairi A., Angermueller C., Bahdanau D., Ballas N., Bastien F., Bayer J., Belikov A., Belopolsky A., et al., Theano: A python framework for fast computation of mathematical expressions, arXiv preprint arXiv: 1605.02688, 2016.
Google Scholar
[131]
Goodfellow I. J., Warde-Farley D., Lamblin P., Dumoulin V., Mirza M., Pascanu R., Bergstra J., Bastien F., and Bengio Y., Pylearn2: A machine learning research library, arXiv preprint arXiv: 1308.4214, 2013.
Google Scholar
[132]
Chollet F., Keras: Theano-based deep learning library, Code, https://github.com/fchollet.Documentation:http://keras.io, 2015.
[133]
Abadi M., Agarwal A., Barham P., Brevdo E., Chen Z. F., Citro C., Corrado G. S., Davis A., Dean J., Devin M., et al., TensorFlow: Large-scale machine learning on heterogeneous distributed systems, arXiv preprint arXiv: 1603.04467, 2016.
Google Scholar
[134]
Yu D., Eversole A., Seltzer M., Yao K. S., Kuchaiev O., Zhang Y., Seide F., Huang Z. H., Guenter B., Wang H. M., et al., An introduction to computational networks and the computational network toolkit, Technical report, Tech. Rep. MSR-TR-2014-112, 2014.
Google Scholar
[135]
Chen T. Q., Li M., Li Y. T., Lin M., Wang N. Y., Wang M. J., Xiao T. J., Xu B., Zhang C. Y., and Zhang Z., MXNet: A flexible and efficient machine learning library for heterogeneous distributed systems, arXiv preprint arXiv: 1512.01274, 2015.
Google Scholar
[136]
Tokui S., Oono K., Hido S., and Clayton J., Chainer: A next-generation open source framework for deep learning, in Proc. Workshop on Machine Learning Systems (LearningSys) in the Twenty-Ninth Annual Conf. Neural Information Processing Systems (NIPS), 2015.
[137]
Deeplearning4j Development Team, Deeplearning4j: Open-source distributed deep learning for the JVM, Apache Software Foundation License 2.0, http://deeplearning4j.org, 2017.
[138]
Ooi B. C., Tan K. L., Wang S., Wang W., Cai Q. C., Chen G., Gao J. Y., Luo Z. J., Tung A. K. H., Wang Y., et al., SINGA: A distributed deep learning platform, in Proc. 23rd ACM Int. Conf. Multimedia, Brisbane, Australia, 2015, pp. 685-688.
[139]
Vedaldi A. and Lenc K., MatConvNet: Convolutional neural networks for MATLAB, in Proc. 23rd ACM Int. Conf. Multimedia, Brisbane, Australia, 2015, pp. 689-692.
Crossref
[140]
Lavin A., MaxDNN: An efficient convolution kernel for deep learning with maxwell GPUs, arXiv preprint arXiv: 1501.06633, 2015.
Google Scholar
[141]
Dolz J., Desrosiers C., and Ayed I. B., 3D fully convolutional networks for subcortical segmentation in MRI: A large-scale study, arXiv preprint arXiv: 1612.03925, 2016.
Google Scholar
[142]
Sarraf S. and Tofighi G., Deep learning-based pipeline to recognize alzheimer’s disease using fMRI data, in Future Technologies Conf. (FTC), San Francisco, CA, USA, 2016, pp. 816-820.
Crossref
[143]
Korolev S., Safiullin A., Belyaev M., and Dodonova Y., Residual and plain convolutional neural networks for 3D brain MRI classification, arXiv preprint arXiv: 1701.06643, 2017.
Google Scholar
[144]
Huang T. W., Chen H. T., Fujimoto R., Ito K., Wu K., Sato K., Taki Y., Fukuda H., and Aoki T., Age estimation from brain MRI images using deep learning, in Proc. 14th Int. Symposium on Biomedical Imaging (ISBI 2017), Melbourne, Australia, 2017, pp. 849-852.
Crossref
[145]
Kamnitsas K., Ledig C., Newcombe V. F. J., Simpson J. P., Kane A. D., Menon D. K., Rueckert D., and Glocker B., Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation, Med. Image Anal., vol. 36, pp. 61-78, 2017.
Crossref Google Scholar
Big Data Mining and Analytics
Volume 1 Issue 1,
March 2018
Pages 1-18
DOI: 10.26599/BDMA.2018.9020001
Cite this article:
Liu J, Pan Y, Li M, et al. Applications of Deep Learning to MRI Images: A Survey. Big Data Mining and Analytics, 2018, 1(1): 1-18. https://doi.org/10.26599/BDMA.2018.9020001

2120

Views

222

Downloads

215

Crossref

165

Web of Science

229

Scopus

0

CSCD

Altmetrics
Received: 26 July 2017
Accepted: 01 November 2017
Published: 25 January 2018
© The author(s) 2018
Return