AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
PDF (2.2 MB)
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Research Article | Open Access

Pairwise constraint propagation via low-rank matrix recovery

College of Computer, Nanjing University of Posts and Telecommunications, Nanjing 210003, China
Show Author Information

Abstract

As a kind of weaker supervisory information, pairwise constraints can be exploited to guide the data analysis process, such as data clustering. This paper formulates pairwise constraint propagation, which aims to predict the large quantity of unknown constraints from scarce known constraints, as a low-rank matrix recovery (LMR) problem. Although recent advances in transductive learning based on matrix completion can be directly adopted to solve this problem, our work intends to develop a more general low-rank matrix recovery solution for pairwise constraint propagation, which not only completes the unknown entries in the constraint matrix but also removes the noise from the data matrix. The problem can be effectively solved using an augmented Lagrange multiplier method. Experimental results on constrained clustering tasks based on the propagated pairwise constraints have shown that our method can obtain more stable results than state-of-the-art algorithms, and outperform them.

References

[1]
Basu S.; Bilenko M.; Mooney R. J. A probabilistic framework for semi-supervised clustering. In: Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, 59-68, 2004.
[2]
Basu S.; Davidson I.; Wagstaff K. Constrained Clustering: Advances in Algorithms, Theory, and Applications. Chapman & Hall/CRC, 2008.
[3]
Kamvar S. D.; Klein D.; Manning C. D. Spectral learning. In: Proceedings of the 18th international joint conference on Artificial intelligence, 561-566, 2003.
[4]
Kulis B.; Basu S.; Dhillon I.; Mooney R. Semi-supervised graph clustering: A kernel approach. In: Proceedings of the 22nd international conference on Machine learning, 457-464, 2005.
[5]
Xing E. P.; Jordan M. I.; Russell S. J.; Ng A. Y. Distance metric learning with application to clustering with side-information. In: Advances in Neural Information Processing Systems 15, 2002. Available at http://papers.nips.cc/paper/2164-distance-metric-learning-with-application-to-clustering-with-side-information.pdf.
[6]
Li Z.; Liu J. Constrained clustering by spectral kernel learning. In: IEEE 12th International Conference on Computer Vision, 421-427, 2009.
[7]
Li Z.; Liu J.; Tang X. Pairwise constraint propagation by semidefinite programming for semi-supervised classification. In: Proceedings of the 25th international conference on Machine learning, 576-583, 2008.
[8]
Lu Z.; Ip H. H. S. Constrained spectral clustering via exhaustive and efficient constraint propagation. Lecture Notes in Computer Science Vol. 6316, 1-14, 2010.
[9]
Lu Z.; Carreira-Perpinán M. A. Constrained spectral clustering through affinity propagation. In: IEEE Conference on Computer Vision and Pattern Recognition, 1-8, 2008.
[10]
Fu Z.; Ip H. H. S.; Lu H.; Lu Z. Multi-modal constraint propagation for heterogeneous image clustering. In: Proceedings of the 19th ACM international conference on Multimedia, 143-152, 2011.
[11]
Fu Z.; Lu H.; Ip H. H. S.; Lu Z. Modalities consensus for multi-modal constraint propagation. In: Proceedings of the 20th ACM international conference on Multimedia, 773-776, 2012.
[12]
Fu Z.; Lu H.; Li W. Incremental visual objects clustering with the growing vocabulary tree. Multimedia Tools and Applications Vol. 56, No. 3, 535-552, 2012.
[13]
Fu Z.; Lu Z.; Ip H. H. S.; Lu H.; Wang Y. Local similarity learning for pairwise constraint propagation. Multimedia Tools and Applications Vol. 74, No. 11, 3739-3758, 2015.
[14]
Fu Z.; Lu Z.; Ip H. H. S.; Peng Y.; Lu H. Symmetric graph regularized constraint propagation. In: Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence, 350-355, 2011.
[15]
Zhu X.; Goldberg A. B. Introduction to semi-supervised learning. Synthesis Lectures on Artificial Intelligence and Machine Learning Vol. 3, No. 1, 1-130, 2009.
[16]
Cabral R. S.; de la Torre F.; Costeira J. P.; Bernardino A. Matrix completion for multi-label image classification. In: Advances in Neural Information Processing Systems 24, 2011. Available at http://papers.nips.cc/paper/4419-matrix-completion-for-multi-label-image-classification.pdf.
[17]
Goldberg A.; Recht B.; Xu J.; Nowak R.; Zhu X. Transduction with matrix completion: Three birds with one stone. In: Advances in Neural Information Processing Systems 23, 2010. Available at http://papers.nips.cc/paper/3932-transduction-with-matrix-completion-three-birds-with-one-stone.pdf.
[18]
Candès E. J.; Li X.; Ma Y.; Wright J. Robust principal component analysis?. Journal of the ACM Vol. 58, No. 3, Article No. 11, 2009.
[19]
Candès E. J.; Recht B. Exact matrix completion via convex optimization. Foundations of Computational Mathematics Vol. 9, No. 6, 717-772, 2009.
[20]
Fazel M. Matrix rank minimization with applications. Ph.D. Thesis. Stanford University, 2002.
[21]
Candès E. J.; Tao T. The power of convex relaxation: Near-optimal matrix completion. IEEE Transactions on Information Theory Vol. 56, No. 5, 2053-2080, 2010.
[22]
Cai J.-F.; Candès E. J.; Shen Z. A singular value thresholding algorithm for matrix completion. SIAM Journal on Optimization Vol. 20, No. 4, 1956-1982, 2010.
[23]
Ma S.; Goldfarb D.; Chen L. Fixed point and Bregman iterative methods for matrix rank minimization. Mathematical Programming Vol. 128, Nos. 1–2, 321-353, 2011.
[24]
Lin Z.; Chen M.; Ma Y. The augmented Lagrange multiplier method for exact recovery of corrupted low-rank matrices. arXiv: 1009.5055, 2010.
[25]
Liu G.; Lin Z.; Yu Y. Robust subspace segmentation by low-rank representation. In: Proceedings of the 27th International Conference on Machine Learning, 2010. Available at http://www.icml2010.org/papers/521.pdf.
[26]
Wright J.; Ganesh A.; Rao S.; Peng Y.; Ma Y. Robust principal component analysis: Exact recovery of corrupted low-rank matrices via convex optimization. In: Advances in Neural Information Processing Systems 22, 2009. Available at http://papers.nips.cc/paper/3704-robust-principal-component-analysis-exact-recovery-of-corrupted-low-rank-matrices-via-convex-optimization.pdf.
[27]
Hale E. T.; Yin W.; Zhang Y. Fixed-point continuation for l1-minimization: Methodology and convergence. SIAM Journal on Optimization Vol. 19, No. 3, 1107-1130, 2008.
[28]
Nocedal J.; Wright S. Numerical Optimization. New York, NY, USA: Springer, 1999.
[29]
Von Luxburg U. A tutorial on spectral clustering. Statistics and Computing Vol. 17, No. 4, 395-416, 2007.
[30]
Shi J.; Malik J. Normalized cuts and image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 22, No. 8, 888-905, 2000.
[31]
Oliva A.; Torralba A. Modeling the shape of the scene: A holistic representation of the spatial envelope. International Journal of Computer Vision Vol. 42, No. 3, 145-175, 2001.
[32]
Bosch A.; Zisserman A.; Muñoz X. Scene classification via pLSA. Lecture Notes in Computer Science Vol. 3954, 517-530, 2006.
[33]
Lu Z.; Ip H. H. S. Image categorization by learning with context and consistency. In: IEEE Conference on Computer Vision and Pattern Recognition, 2719-2726, 2009.
[34]
Strehl A.; Ghosh J. Cluster ensembles—a knowledge reuse framework for combining multiple partitions. The Journal of Machine Learning Research Vol. 3, 583-617, 2003.
Computational Visual Media
Pages 211-220
Cite this article:
Fu Z. Pairwise constraint propagation via low-rank matrix recovery. Computational Visual Media, 2015, 1(3): 211-220. https://doi.org/10.1007/s41095-015-0011-7

706

Views

18

Downloads

5

Crossref

N/A

Web of Science

5

Scopus

0

CSCD

Altmetrics

Revised: 05 December 2014
Accepted: 18 March 2015
Published: 14 August 2015
© The Author(s) 2015

This article is published with open access at Springerlink.com

This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.

Other papers from this open access journal are available at no cost from http://www.springer.com/journal/41095. To submit a manuscript, please go to https://www.editorialmanager.com/cvmj.

Return