AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
PDF (707.1 KB)
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Open Access

LKLR: A Local Tangent Space-Alignment Kernel Least-Squares Regression Algorithm

School of Computer Science and Engineering, Southeast University, Nanjing 210096.
School of Computer Science and Technology, Nanjing Normal University, Nanjing 210023, China.
Show Author Information

Abstract

In the fields of machine learning and data mining, label learning is a nascent area of research, and within this paradigm, there is much room for improving multi-label manifold learning algorithms for high-dimensional data. Thus far, researchers have experimented with mapping relationships from the feature space to the traditional logical label space (using neighbors in the label space, for example, to predict logical label vectors from the feature space’s manifold structure). Here we combine the feature manifold’s and label space’s local topological structures to reconstruct the label manifold. To achieve this, we use a nonlinear manifold learning algorithm to transform the local topological structure from the feature space to the label space. Our algorithm adopts a regularized least-squares kernel method to realize the reconstruction process, employing an optimization function to find the best solution. Extensive experiments show that our algorithm significantly improves multi-label manifold learning in terms of learning accuracy and time complexity.

References

[1]
Z. Q., Wang J. C., Xin H. X., Yang S., Tian G., Yu C. R. Xu, and Y. D. Yao, Distributed and weighted extreme learning machine for imbalanced big data learning, Tsinghua Science and Technology, vol. 22, no. 2, pp. 160-173, 2017.
[2]
G. Tsoumakas and I. Katakis, Multi-label classification: An overview, International Journal of Data Warehousing Mining, vol. 3, no. 3, pp. 1-13, 2007.
[3]
X. Geng, Label distribution learning, IEEE Transactions on Knowledge and Data Engineering, vol. 28, no. 7, pp. 1734-1748, 2016.
[4]
P., Hou X. Geng, and M. L. Zhang, Multi-label manifold learning, in Proc. 13th AAAI Conf. Artificial Intelligence, Palo Alto, CA, USA, 2016, pp. 1680-1686.
[5]
M. L. Zhang and Z. H. Zhou, A review on multi-label learning algorithms, IEEE Transactions on Knowledge and Data Engineering, vol. 26, no. 8, pp. 1819-1837, 2014.
[6]
M. L. Zhang and Z. H. Zhou, ML-KNN: A lazy learning approach to multi-label learning, Pattern Recognition, vol. 40, no. 7, pp. 2038-2048, 2007.
[7]
J., Fürnkranz E., Hüllermeier E. L. Mencía, and K. Brinker, Multilabel classification via calibrated label ranking, Machine Learning, vol. 73, no. 2, pp. 133-153, 2008.
[8]
G., Tsoumakas I. Katakis, and I. Vlahavas, Random k-labelsets for multilabel classification, IEEE Transactions on Knowledge and Data Engineering, vol. 23, no. 7, pp. 1079-1089, 2011.
[9]
L., Sun S. W. Ji, and J. P. Ye, Canonical correlation analysis for multilabel classification: A least-squares formulation, extensions, and analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 1, pp. 194-200, 2011.
[10]
Z. Y. Zhang and H. Y. Zha, Principal manifolds and nonlinear dimensionality reduction via tangent space alignment, SIAM Journal on Scientific Computing, vol. 26, no. 1, pp. 313-338, 2004.
[11]
M., Belkin P. Niyogi, and V. Sindhwani, Manifold regularization: A geometric framework for learning from labeled and unlabeled examples, Journal of Machine Learning Research, vol. 7, pp. 2399-2434, 2006.
[12]
P. Niyogi, Manifold regularization and semi-supervised learning: Some theoretical analyses, Journal of Machine Learning Research, vol. 14, pp. 1229-1250, 2013.
[13]
L., Chen I. W. Tsang, and D. Xu, Laplacian embedded regression for scalable manifold regularization, IEEE Transactions on Neural Networks and Learning Systems, vol. 23, no. 6, pp. 902-915, 2012.
[14]
M., Belkin P. Niyogi, and V. Sindhwani, On manifold regularization, https://newtraell.cs.uchicago.edu/files/tr_authentic/TR-2004-05.pdf, 2005.
[15]
L. B., Qiao B. F., Zhang X. C. Lu, and J. S. Su, Adaptive linearized alternating direction method of multipliers for non-convex compositely regularized optimization problems, Tsinghua Science and Technology, vol. 22, no. 3, pp. 328-341, 2017.
[16]
D., Tuia J., Verrelst L., Alonso F. Prez-Cruz, and G. Camps-Valls, Multioutput support vector regression for remote sensing biophysical parameter estimation, IEEE Geoscience and Remote Sensing Letters, vol. 8, no. 4, pp. 804-808, 2011.
[17]
C., Tan C. Chen, and J. H. Guan, A nonlinear dimension reduction method with both distance and neighborhood preservation, in Knowledge Science, Engineering and Management, M. Wang, ed. Springer, 2013, pp. 48-63.
[18]
C., Tan J. H. Guan, and S. G. Zhou, IKLTSA: An incremental kernel LTSA method, in Machine Learning and Data Mining in Pattern Recognition, P. Perner, ed. Springer, 2015, pp. 70-83.
[19]
Mulan, multi-label datasets for multi-label learning, http://mulan.sourceforge.net/datasets-mlc.html, 2018.
[20]
M. L., Zhang J. M. Peña, and V. Robles, Feature selection for multi-label naive Bayes classification, Information Sciences, vol. 179, no. 19, pp. 3218-3229, 2009.
[21]
Q. W., Zhang Y. Zhong, and M. L. Zhang, Feature-induced labeling information enrichment for multi-label learning, in Proc. 32nd AAAI Conf. Artificial Intelligence, New Orleans, LA, USA, 2018, pp. 4446-4453.
[22]
J. Demšar, Statistical comparisons of classifiers over multiple data sets, Journal of Machine Learning Research, vol. 7, pp. 1-30, 2006.
Tsinghua Science and Technology
Pages 389-399
Cite this article:
Tan C, Ji G. LKLR: A Local Tangent Space-Alignment Kernel Least-Squares Regression Algorithm. Tsinghua Science and Technology, 2019, 24(4): 389-399. https://doi.org/10.26599/TST.2018.9010120

603

Views

45

Downloads

2

Crossref

N/A

Web of Science

3

Scopus

0

CSCD

Altmetrics

Received: 09 July 2018
Accepted: 01 September 2018
Published: 07 March 2019
© The author(s) 2019
Return