AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Powered by AMiner. Clicking this button will take you away from SciOpen.
Home Computational Visual Media Article
PDF (2.7 MB)
Cite
EndNote(RIS) BibTeX
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Research Article | Open Access

Face image retrieval based on shape and texture feature fusion

School of Information and Control Engineering, Nanjing University of Information Science and Technology, China.
Show Author Information

Abstract

Humongous amounts of data bring various challenges to face image retrieval. This paper proposes an efficient method to solve those problems. Firstly, we use accurate facial landmark locations as shape features. Secondly, we utilise shape priors to provide discriminative texture features for convolutional neural networks. These shape and texture features are fused to make the learned representation more robust. Finally, in order to increase efficiency, a coarse-to-fine search mechanism is exploited to efficiently find similar objects. Extensive experiments on the CASIA-WebFace, MSRA-CFW, and LFW datasets illustrate the superiority of our method.

Keywords

face retrievalconvolutional neural networks (CNNs)coarse-to-fine

References

[1]
C. H. Chan,; M. A. Tahir,; J. Kittler,; M Pietikainen,. Multiscale local phase quantization for robust component-based face recognition using kernel fusion of multiple descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 35, No. 5, 1164-1177, 2013.
Crossref Google Scholar
[2]
Z. Wu,; Q. Ke,; J. Sun,; H.-Y Shum,. Scalable face image retrieval with identity-based quantization and multireference reranking. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 33, No. 10, 1991-2001, 2011.
Crossref Google Scholar
[3]
J. R. Bach,; S. Paul,; R Jain,. A visual information management system for the interactive retrieval of faces. IEEE Transactions on Knowledge and Data Engineering Vol. 5, No. 4, 619-628, 1993.
Crossref Google Scholar
[4]
S. Eickeler, Face database retrieval using pseudo 2D hidden Markov models. In: Proceedings of the 5th IEEE International Conference on Automatic Face Gesture Recognition, 58-63, 2002.
[5]
V. N. Gudivada,; V. V Raghavan,. Modeling and retrieving images by content. Information Processing & Management Vol. 33, No. 4, 427-452, 1997.
Crossref Google Scholar
[6]
X. Wang,; C. Zhang,; Z. Zhang, Boosted multi-task learning for face verification with applications to web image and video search. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 142-149, 2009.
[7]
T. Ojala,; M. Pietikainen,; T Maenpaa,. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 24, No. 7, 971-987, 2002.
Crossref Google Scholar
[8]
O. M. Parkhi,; A. Vedaldi,; A. Zisserman, Deep face recognition. In: Proceedings of the British Machine Vision Conference, 2015. Available at http://www.bmva.org/bmvc/2015/papers/paper041/ abstract041.pdf.
Crossref
[9]
F. Schroff,; D. Kalenichenko,; J. Philbin, FaceNET: A unified embedding for face recognition and clustering. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 815-823, 2015.
Crossref
[10]
Y. Sun,; Y. Chen,; X. Wang,; X. Tang, Deep learning face representation by joint identification-verification. In: Proceedings of the Advances in Neural Information Processing Systems 27, 1988-1996, 2014.
[11]
Y. Sun,; X. Wang,; X Tang,. Hybrid deep learning for face verification. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 38, No. 10, 1997-2009, 2016.
Crossref Google Scholar
[12]
Y. Taigman,; M. Yang,; M. Ranzato,; L. Wolf, DeepFace: Closing the gap to human-level performance in face verification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1701-1708, 2014.
Crossref
[13]
Y. Wen,; Z. Li,; Y. Qiao, Latent factor guided convolutional neural networks for age-invariant face recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 4893-4901, 2016.
Crossref
[14]
S. Chopra,; R. Hadsell,; Y. Lecun, Learning a similarity metric discriminatively, with application to face verification. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 1, 539-546, 2005.
[15]
Y. Sun,; X. Wang,; X. Tang, Deep learning face representation from predicting 10,000 classes. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1891-1898, 2014.
Crossref
[16]
Y. Sun,; X. Wang,; X. Tang, Deeply learned face representations are sparse, selective, and robust. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2892-2900, 2015.
Crossref
[17]
J. Liu,; Y. Deng,; T. Bai,; Z. Wei,; C Huang,. Targeting ultimate accuracy: Face recognition via deep embedding. arXiv preprint arXiv:1506.07310, 2015.
[18]
X. Xiong,; F. D. la Torre, Supervised descent method and its applications to face alignment. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 532-539, 2013.
Crossref
[19]
C. Szegedy,; W. Liu,; Y. Jia,; P. Sermanet,; S. Reed,; D. Anguelov,; D. Erhan,; V. Vanhoucke,; A. Rabinovich, Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1-9, 2015.
Crossref
[20]
C. Szegedy,; V. Vanhoucke,; S. Ioffe,; J. Shlens,; Z. Wojna, Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2818-2826, 2016.
Crossref
[21]
M. Lin,; Q. Chen,; S Yan,. Network in network. arXiv preprint arXiv:1312.4400, 2013.
[22]
D. Yi,; Z. Lei,; S. Liao,; S. Z Li,. Learning face representation from scratch. arXiv preprint arXiv:1411.7923, 2014.
[23]
MSRA-CFW: Data set of celebrity faces on the web. Available at https://www.microsoft.com/en-us/ research/project/msra-cfw-data-set-of-celebrity-faces-on-the-web/.
[24]
G. B. Huang,; M. Mattar,; T. Berg,; E. Learned-Miller, Labeled faces in the wild: A database for studying face recognition in unconstrained environments. In: Proceedings of the Workshop on Faces in “Real-Life” Images: Detection, Alignment, and Recognition, 2008.
[25]
Z. Cao,; Q. Yin,; X. Tang,; J. Sun, Face recognition with learning-based descriptor. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2707-2714, 2010.
Crossref
[26]
N. Kumar,; A. C. Berg,; P. N. Belhumeur,; S. K. Nayar, Attribute and simile classifiers for face verification. In: Proceedings of the IEEE 12th International Conference on Computer Vision, 365-372, 2009.
Crossref
[27]
Q. Yin,; X. Tang,; J. Sun, An associate-predict model for face recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 497-504, 2011.
Crossref
[28]
Y. Taigman,; L Wolf,. Leveraging billions of faces to overcome performance barriers in unconstrained face recognition. arXiv preprint arXiv:1108.1122, 2011.
[29]
D. Chen,; X. Cao,; L. Wang,; F. Wen,; J. Sun, Bayesian face revisited: A joint formulation. In: Computer Vision-ECCV 2012. A. Fitzgibbon,; S. Lazebnik,; P. Perona,; Y. Sato,; C. Schmid, Eds. Springer Berlin Heidelberg, 566-579, 2012.
[30]
T. Berg,; P. N. Belhumeur, POOF: Part-based one-vs.-one features for fine-grained categorization, face verification, and attribute estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 955-962, 2013.
Crossref
[31]
T. Berg,; P. N. Belhumeur, Tom-vs-Pete classifiers and identity-preserving alignment for face verification. In: Proceedings of the British Machine Vision Conference, 2012. Available at http://www.bmva.org/bmvc/2012/BMVC/paper129/ paper129.pdf.
Crossref
[32]
D. Chen,; X. Cao,; F. Wen,; J. Sun, Blessing of dimensionality: High-dimensional feature and its efficient compression for face verification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3025-3032, 2013.
Crossref
[33]
X. Cao,; D. Wipf,; F. Wen,; G. Duan,; J. Sun, A practical transfer learning algorithm for face verification. In: Proceedings of the IEEE International Conference on Computer Vision, 3208-3215, 2013.
Crossref
[34]
Z. Zhu,; P. Luo,; X. Wang,; X Tang,. Recover canonical-view faces in the wild with deep neural networks. arXiv preprint arXiv:1404.3543, 2014.
[35]
TCIT. Available at http://www.tcit-us.com/.
[36]
INSKY. Available at http://www.insky.so/.
[37]
DaHua-FaceImage. Available at http://www. dahuatech.com/.
Computational Visual Media
Volume 3 Issue 4,
December 2017
Pages 359-368
DOI: 10.1007/s41095-017-0091-7
Cite this article:
Lu Z, Yang J, Liu Q. Face image retrieval based on shape and texture feature fusion. Computational Visual Media, 2017, 3(4): 359-368. https://doi.org/10.1007/s41095-017-0091-7

548

Views

31

Downloads

13

Crossref

N/A

Web of Science

16

Scopus

0

CSCD

Altmetrics
Revised: 27 February 2017
Accepted: 26 May 2017
Published: 02 August 2017
© The Author(s) 2017

This article is published with open access at Springerlink.com

The articles published in this journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Other papers from this open access journal are available free of charge from http://www.springer.com/journal/41095. To submit a manuscript, please go to https://www.editorialmanager.com/cvmj.
Return