AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
PDF (13.1 MB)
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Open Access

Multiple Deep-Belief-Network-Based Spectral-Spatial Classification of Hyperspectral Images

Pervasive Computing Division, Tsinghua National Laboratory for Information Science and Technology, Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China.
Show Author Information

Abstract

A deep-learning-based feature extraction has recently been proposed for HyperSpectral Images (HSI) classification. A Deep Belief Network (DBN), as part of deep learning, has been used in HSI classification for deep and abstract feature extraction. However, DBN has to simultaneously deal with hundreds of features from the HSI hyper-cube, which results into complexity and leads to limited feature abstraction and performance in the presence of limited training data. Moreover, a dimensional-reduction-based solution to this issue results in the loss of valuable spectral information, thereby affecting classification performance. To address the issue, this paper presents a Spectral-Adaptive Segmented DBN (SAS-DBN) for spectral-spatial HSI classification that exploits the deep abstract features by segmenting the original spectral bands into small sets/groups of related spectral bands and processing each group separately by using local DBNs. Furthermore, spatial features are also incorporated by first applying hyper-segmentation on the HSI. These results improved data abstraction with reduced complexity and enhanced the performance of HSI classification. Local application of DBN-based feature extraction to each group of bands reduces the computational complexity and results in better feature extraction improving classification accuracy. In general, exploiting spectral features effectively through a segmented-DBN process and spatial features through hyper-segmentation and integration of spectral and spatial features for HSI classification has a major effect on the performance of HSI classification. Experimental evaluation of the proposed technique on well-known HSI standard data sets with different contexts and resolutions establishes the efficacy of the proposed techniques, wherein the results are comparable to several recently proposed HSI classification techniques.

References

[1]
Willett R. M., Duarte M. F., Davenport M. A., and Baraniuk R. G., Sparsity and structure in hyperspectral imaging: Sensing, reconstruction, and target detection, IEEE Signal Process. Mag., vol. 31, no. 1, pp. 116-126, 2014.
[2]
Van Der Meer F., Analysis of spectral absorption features in hyperspectral imagery, Int. J. Appl. Earth Obs. Geoinf., vol. 5, no. 1, pp. 55-68, 2004.
[3]
Lacar F. M., Lewis M. M., and Grierson I. T., Use of hyperspectral imagery for mapping grape varieties in the Barossa Valley, South Australia, in Proc. 2001 Int. Geoscience and Remote Sensing Symp. on Scanning the Present and Resolving the Future, Sydney, Australia, 2001, pp. 2875-2877.
[4]
Malthus T. J. and Mumby P. J., Remote sensing of the coastal zone: An overview and priorities for future research, Int. J. Remote Sens., vol. 24, no. 13, pp. 2805-2815, 2003.
[5]
Yuen P. W. T. and Richardson M., An introduction to hyperspectral imaging and its application for security, surveillance and target acquisition, Imaging Sci. J., vol. 58, no. 5, pp. 241-253, 2010.
[6]
Kuybeda O., Malah D., and Barzohar M., Rank estimation and redundancy reduction of high-dimensional noisy signals with preservation of rare vectors, IEEE Trans. Signal Process., vol. 55, no. 12, pp. 5579-5592, 2007.
[7]
Jia X. P., Kuo B. C., and Crawford M. M., Feature mining for hyperspectral image classification, Proc. IEEE, vol. 101, no. 3, pp. 676-697, 2013.
[8]
Chen Y. S., Lin Z. H., Zhao X., Wang G., and Gu Y. F., Deep learning-based classification of hyperspectral data, IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., vol. 7, no. 6, pp. 2094-2107, 2014.
[9]
Hughes G., On the mean accuracy of statistical pattern recognizers, IEEE Trans. Inf. Theory, vol. 14, no. 1, pp. 55-63, 1968.
[10]
Bioucas-Dias J. M., Plaza A., Camps-Valls G., Scheunders P., Nasrabadi N., and Chanussot J., Hyperspectral remote sensing data analysis and future challenges, IEEE Geosci. Remote Sens. Mag., vol. 1, no. 2, pp. 6-36, 2013.
[11]
Di W., Zhang L., Zhang D., and Pan Q., Studies on hyperspectral face recognition in visible spectrum with feature band selection, IEEE Trans. Syst., Man, Cybern.-Part A: Syst. Humans, vol. 40, no. 6, pp. 1354-1361, 2010.
[12]
Mughees A., Chen X. Q., Du R. C., and Tao L. M., AB3C: Adaptive boundary-based band-categorization of hyperspectral images, J. Appl. Remote Sens., vol. 10, no. 4, p. 046009, 2016.
[13]
Yeung K. Y. and Ruzzo W. L., Principal component analysis for clustering gene expression data, Bioinformatics, vol. 17, no. 9, pp. 763-774, 2001.
[14]
Calhoun V. D., Adali T., Pearlson G. D., and Pekar J. J., A method for making group inferences from functional MRI data using independent component analysis, Human Brain Mapp., vol. 14, no. 3, pp. 140-151, 2001.
[15]
Zabalza J., Ren J. C., Yang M. Q., Zhang Y., Wang J., Marshall S., and Han J. W., Novel folded-PCA for improved feature extraction and data reduction with hyperspectral imaging and SAR in remote sensing, ISPRS J. Photogramm. Remote Sens., vol. 93, pp. 112-122, 2014.
[16]
Jimenez-Rodriguez L. O., Arzuaga-Cruz E., and Velez-Reyes M., Unsupervised linear feature-extraction methods and their effects in the classification of high-dimensional data, IEEE Trans. Geosci. Remote Sens., vol. 45, no. 2, pp. 469-483, 2007.
[17]
Serpico S. B. and Moser G., Extraction of spectral channels from hyperspectral images for classification purposes, IEEE Trans. Geosci. Remote Sens., vol. 45, no. 2, pp. 484-495, 2007.
[18]
Krizhevsky A., Sutskever I., and Hinton G. E., ImageNet classification with deep convolutional neural networks, in Proc. 25th Int. Conf. Neural Information Processing Systems, Lake Tahoe, NV, USA, 2012, pp. 1097-1105.
[19]
Yuan Z. L., Lu Y. Q., and Xue Y. B., Droiddetector: Android malware characterization and detection using deep learning, Tsinghua Sci. Technol., vol. 21, no. 1, pp. 114-123, 2016.
[20]
Gao Y. and Dai Q. H., Efficient view-based 3-D object retrieval via hypergraph learning, Tsinghua Sci. Technol., vol. 19, no. 3, pp. 250-256, 2014.
[21]
Chen X. P. and Huang H., Immune feed-forward neural network for fault detection, Tsinghua Sci. Technol., vol. 16, no. 3, pp. 272-277, 2011.
[22]
Chen Y. S., Zhao X., and Jia X. P., Spectral–spatial classification of hyperspectral data based on deep belief network, IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., vol. 8, no. 6, pp. 2381-2392, 2015.
[23]
Fauvel M., Tarabalka Y., Benediktsson J. A., Chanussot J., and Tilton J. C., Advances in spectral-spatial classification of hyperspectral images, Proc. IEEE, vol. 101, no. 3, pp. 652-675, 2013.
[24]
Zhao W. Z. and Du S. H., Spectral–spatial feature extraction for hyperspectral image classification: A dimension reduction and deep learning approach, IEEE Trans. Geosci. Remote Sens., vol. 54, no. 8, pp. 4544-4554, 2016.
[25]
Zhao W. Z. and Du S. H., Learning multiscale and deep representations for classifying remotely sensed imagery, ISPRS J. Photogramm. Remote Sens., vol. 113, pp. 155-165, 2016.
[26]
Mughees A. and Tao L. M., Efficient deep auto-encoder learning for the classification of hyperspectral images, in Proc. 2016 Int. Conf. Virtual Reality and Visualization, Hangzhou, China, 2016, pp. 44-51.
[27]
Mughees A., Ali A., and Tao L. M., Hyperspectral image classification via shape-adaptive deep learning, in Proc. 2017 IEEE Int. Conf. Image Processing, Beijing, China, 2017.
[28]
Fauvel M., Benediktsson J. A., Chanussot J., and Sveinsson J. R., Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles, IEEE Trans. Geosci. Remote Sens., vol. 46, no. 11, pp. 3804-3814, 2008.
[29]
Li J., Bioucas-Dias J. M., and Plaza A., Spectral–spatial classification of hyperspectral data using loopy belief propagation and active learning, IEEE Trans. Geosci. Remote Sens., vol. 51, no. 2, pp. 844-856, 2013.
[30]
Liu J. J., Wu Z. B., Wei Z. H., Xiao L., and Sun L., Spatial-spectral kernel sparse representation for hyperspectral image classification, IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., vol. 6, no. 6, pp. 2462-2471, 2013.
[31]
Mughees A. and Tao L. M., Spectral-spatial hyperspectral image classification via boundary-adaptive deep learning, in Proc. 2017 Int. Conf. Digital Image Computing: Techniques and Applications, Sydney, Australia, 2017.
[32]
Mughees A. and Tao L. M., Hyperspectral image classification based on deep auto-encoder and hidden markov random field, in Proc. 13th Int. Conf. Natural Computation, Fuzzy Systems and Knowledge Discovery, Guilin, China, 2017.
[33]
Foody G. M. and Mathur A., A relative evaluation of multiclass image classification by support vector machines, IEEE Trans. Geosci. Remote Sens., vol. 42, no. 6, pp. 1335-1343, 2004.
[34]
Mughees A., Chen X. Q., and Tao L. M., Unsupervised hyperspectral image segmentation: Merging spectral and spatial information in boundary adjustment, in Proc. 55th Annual Conf. the Society of Instrument and Control Engineers of Japan, Tsukuba, Japan, 2016, pp. 1466-1471.
[35]
Ambikapathi A, Chan T. H., Lin C. H., and Chi C. Y., Convex geometry based outlier-insensitive estimation of number of endmembers in hyperspectral images, Signal, vol. 1, pp. 1-20, 2012.
[36]
Hinton G. E., Training products of experts by minimizing contrastive divergence, Neural Comput., vol. 14, no. 8, pp. 1771-1800, 2002.
[37]
Jia X. P. and Richards J. A., Segmented principal components transformation for efficient hyperspectral remote-sensing image display and classification, IEEE Trans. Geosci. Remote Sens., vol. 37, no. 1, pp. 538-542, 1999.
[38]
Melgani F. and Bruzzone L., Classification of hyperspectral remote sensing images with support vector machines, IEEE Trans. Geosci. Remote Sens., vol. 42, no. 8, pp. 1778-1790, 2004.
[39]
Mou L. C., Ghamisi P., and Zhu X. X., Deep recurrent neural networks for hyperspectral image classification, IEEE Trans. Geosci. Remote Sens., vol. 55, no. 7, pp. 3639-3655, 2017.
[40]
Hu W., Huang Y. Y., Wei L., Zhang F., and Li H. C., Deep convolutional neural networks for hyperspectral image classification, J. Sensors, vol. 2015, p. 258619, 2015.
[41]
Benediktsson J. A. and Ghamisi P., Spectral-Spatial Classification of Hyperspectral Remote Sensing Images. Norwood, MA, USA: Artech House, 2015.
Tsinghua Science and Technology
Pages 183-194
Cite this article:
Mughees A, Tao L. Multiple Deep-Belief-Network-Based Spectral-Spatial Classification of Hyperspectral Images. Tsinghua Science and Technology, 2019, 24(2): 183-194. https://doi.org/10.26599/TST.2018.9010043

678

Views

31

Downloads

46

Crossref

N/A

Web of Science

52

Scopus

0

CSCD

Altmetrics

Received: 08 August 2017
Revised: 23 November 2017
Accepted: 11 December 2017
Published: 31 December 2018
© The author(s) 2019
Return