AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Powered by AMiner. Clicking this button will take you away from SciOpen.
Home Computational Visual Media Article
PDF (7.3 MB)
Cite
EndNote(RIS) BibTeX
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Research Article | Open Access

Specificity-preserving RGB-D saliency detection

School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing 210094, China
Key Laboratory of System Control and Information Processing, Ministry of Education, Shanghai, China
Computer Vision Lab, ETH Zürich, Zürich, Switzerland
School of Computer Science and Engineering, North-western Polytechnical University, Xi’an, China
School of Computer Science and Engineering, SoutheastUniversity, Nanjing, China
Inception Institute of Artificial Intelligence, Abu Dhabi, United Arab Emirates
Show Author Information

Graphical Abstract

Abstract

Salient object detection (SOD) in RGB and depth images has attracted increasing research interest. Existing RGB-D SOD models usually adopt fusion strategies to learn a shared representation from RGB and depth modalities, while few methods explicitly consider how to preserve modality-specific characteristics. In this study, we propose a novel framework, the specificity-preserving network (SPNet), which improves SOD performance by exploring both the shared information and modality-specific properties. Specifically, we use two modality-specific networks and a shared learning network to generate individual and shared saliency prediction maps. To effectively fuse cross-modal features in the shared learning network, we propose a cross-enhanced integration module (CIM) and propagate the fused feature to the next layer to integrate cross-level information. Moreover, to capture rich complementary multi-modal information to boost SOD performance, we use a multi-modal feature aggregation (MFA) module to integrate the modality-specific features from each individual decoder into the shared decoder. By using skip connections between encoder and decoder layers, hierarchical features can be fully combined. Extensive experiments demonstrate that our SPNet outperforms cutting-edge approaches on six popular RGB-D SOD and three camouflaged object detection benchmarks. The project is publicly available at https://github.com/taozh2017/SPNet.

Keywords

salient object detection (SOD)RGB-Dcross-enhanced integration module (CIM)multi-modal feature aggregation (MFA)

References

[1]
Peng, H.; Li, B.; Xiong, W.; Hu, W.; Ji, R. RGBD salient object detection: A benchmark and algorithms. In: Computer Vision – ECCV 2014. Lecture Notes in Computer Science, Vol. 8691. Fleet, D.; Pajdla, T.; Schiele, B.; Tuytelaars, T. Eds. Springer Cham, 92–109, 2014.
[2]
Zhu, J.-Y.; Wu, J.-J.; Xu, Y.; Chang, E.; Tu, Z. W. Unsupervised object class discovery via saliency-guided multiple class learning. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 37, No. 4, 862–875, 2015.
Crossref Google Scholar
[3]
Rapantzikos, K.; Avrithis, Y.; Kollias, S. Dense saliency-based spatiotemporal feature points for action recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1454–1461, 2009.
Crossref
[4]
Shimoda, W.; Yanai, K. Distinct class-specific saliency maps for weakly supervised semantic segmentation. In: Computer Vision – ECCV 2016. Lecture Notes in Computer Science, Vol. 9908. Leibe, B.; Matas, J.; Sebe, N.; Welling, M. Eds. Springer Cham, 218–234, 2016.
Crossref
[5]
Wang, W. G.; Shen, J. B.; Yang, R. G.; Porikli, F. Saliency-aware video object segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 40, No. 1, 20–33, 2018.
Crossref Google Scholar
[6]
Zhao, R.; Oyang, W.; Wang, X. Person re-identification by saliency learning. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 39, No. 2, 356–370, 2017.
Crossref Google Scholar
[7]
Fan, D. P.; Lin, Z.; Zhang, Z.; Zhu, M. L.; Cheng, M. M. Rethinking RGB-D salient object detection: Models, data sets, and large-scale benchmarks. IEEE Transactions on Neural Networks and Learning Systems Vol. 32, No. 5, 2075–2089, 2021.
Crossref Google Scholar
[8]
Zhang, J.; Fan, D.-P.; Dai, Y. C.; Yu, X.; Zhong,Y. R.; Barnes, N.; Shao, L. RGB-D saliency detection via cascaded mutual information minimization. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, 4318–4327, 2021.
Crossref
[9]
Liu, N.; Zhang, N.; Wan, K. Y.; Shao, L.; Han, J. W. Visual saliency transformer. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, 4702–4712, 2021.
Crossref
[10]
Zhou, T.; Fan, D. P.; Cheng, M. M.; Shen, J. B.; Shao, L. RGB-D salient object detection: A survey. Computational Visual Media Vol. 7, No. 1, 37–69, 2021.
Crossref Google Scholar
[11]
Fu, K. R.; Fan, D. P.; Ji, G. P.; Zhao, Q. J.; Shen, J. B.; Zhu, C. Siamese network for RGB-D salient object detection and beyond. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2021.
Crossref Google Scholar
[12]
Zhang, J.; Fan, D.-P.; Dai, Y. C.; Anwar, S., Saleh, F., Aliakbarian, S.; Barnes, N. Uncertainty inspired RGB-D saliency detection. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2021.
Crossref Google Scholar
[13]
Chen, H.; Li, Y. F.; Deng, Y. J.; Lin, G. S. CNN-based RGB-D salient object detection: Learn, select, and fuse. International Journal of Computer Vision Vol. 129, No. 7, 2076–2096, 2021.
Crossref Google Scholar
[14]
Li, G. Y.; Liu, Z.; Chen, M. Y.; Bai, Z.; Lin, W. S.; Ling, H. B. Hierarchical alternate interaction network for RGB-D salient object detection. IEEE Transactions on Image Processing Vol. 30, 3528–3542, 2021.
Crossref Google Scholar
[15]
Zhao, Y. F.; Zhao, J. W.; Li, J.; Chen, X. W. RGB-D salient object detection with ubiquitous target awareness. IEEE Transactions on Image Processing Vol. 30, 7717–7731, 2021.
Crossref Google Scholar
[16]
Ren, J. Q.; Gong, X. J.; Lu, Y.; Zhou, W. H.; Yang, M. Y. Exploiting global priors for RGB-D saliency detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 25–32, 2015.
Crossref
[17]
Song, H. K.; Liu, Z.; Du, H.; Sun, G. L.; Le Meur, O.; Ren, T. W. Depth-aware salient object detection and segmentation via multiscale discriminative saliency fusion and bootstrap learning. IEEE Transactions on Image Processing Vol. 26, No. 9, 4204–4216,2017.
Crossref Google Scholar
[18]
Liu, Z. Y.; Shi, S.; Duan, Q. T.; Zhang, W.; Zhao, P. Salient object detection for RGB-D image by single stream recurrent convolution neural network. Neurocomputing Vol. 363, 46–57, 2019.
Crossref Google Scholar
[19]
Guo, J. F.; Ren, T. W.; Bei, J. Salient object detection for RGB-D image via saliency evolution. In: Proceedings of the IEEE International Conference on Multimedia and Expo, 1–6, 2016.
Crossref
[20]
Wang, N. N.; Gong, X. J. Adaptive fusion for RGB-D salient object detection. IEEE Access Vol. 7, 55277–55284, 2019.
Crossref Google Scholar
[21]
Ding, Y.; Liu, Z.; Huang, M. K.; Shi, R.; Wang, X. Y. Depth-aware saliency detection using convolutional neural networks. Journal of Visual Communication and Image Representation Vol. 61, 1–9, 2019.
Crossref Google Scholar
[22]
Chen, H.; Li, Y. F. Progressively complementarity-aware fusion network for RGB-D salient object detection. In: Proceedings of the IEEE/CVF Confe-rence on Computer Vision and Pattern Recognition, 3051–3060, 2018.
Crossref
[23]
Liu, D.; Hu, Y.; Zhang, K.; Chen, Z. Two-stream refinement network for RGB-D saliency detection. In: Proceedings of the IEEE International Conference on Image Processing, 3925–3929, 2019.
Crossref
[24]
Chen, H.; Li, Y. F. Three-stream attention-aware network for RGB-D salient object detection. IEEE Transactions on Image Processing Vol. 28, No. 6, 2825–2835, 2019.
Crossref Google Scholar
[25]
Han, J. W.; Chen, H.; Liu, N.; Yan, C. G.; Li, X. L. CNNs-based RGB-D saliency detection via cross-view transfer and multiview fusion. IEEE Transactions on Cybernetics Vol. 48, No. 11, 3171–3183, 2018.
Crossref Google Scholar
[26]
Chen, H.; Li, Y. F.; Su, D. Attention-aware cross-modal cross-level fusion network for RGB-D salient object detection. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, 6821–6826, 2018.
Crossref
[27]
Ji, W.; Li, J. J.; Yu, S.; Zhang, M.; Piao, Y. R.; Yao, S. Y.; Bi, Q.; Ma, K.; Zheng, Y.; Lu, H.; et al. Calibrated RGB-D salient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 9466–9476, 2021.
Crossref
[28]
Huang, Z.; Chen, H. X.; Zhou, T.; Yang, Y. Z.; Liu, B. Y. Multi-level cross-modal interaction network for RGB-D salient object detection. Neurocomputing Vol. 452, 200–211, 2021.
Crossref Google Scholar
[29]
Chen, H.; Li, Y. F.; Su, D. Multi-modal fusion network with multi-scale multi-path and cross-modal interactions for RGB-D salient object detection. Pattern Recognition Vol. 86, 376–385, 2019.
Crossref Google Scholar
[30]
Zhao, J.-X.; Cao, Y.; Fan, D.-P.; Cheng, M.-M.; Li, X.-Y.; Zhang, L. Contrast prior and fluid pyramid integration for RGBD salient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3922–3931, 2019.
Crossref
[31]
Zhu, C. B.; Cai, X.; Huang, K.; Li, T. H.; Li, G. PDNet: Prior-model guided depth-enhanced network for salient object detection. In: Proceedings of the IEEE International Conference on Multimedia and Expo, 199–204, 2019.
Crossref
[32]
Fan, D. P.; Zhai, Y.; Borji, A.; Yang, J.; Shao, L. BBS-Net: RGB-D salient object detection with a bifurcated backbone strategy network. In: Computer Vision – ECCV 2020. Lecture Notes in Computer Science, Vol. 12357. Vedaldi, A.; Bischof, H.; Brox, T.; Frahm, J. M. Eds. Springer Cham, 275–292, 2020.
[33]
Zhai, Y. J.; Fan, D.-P.; Yang, J. F.; Borji, A.; Shao, L.; Han, J. W.; Wang, L. Bifurcated backbone strategy for RGB-D salient object detection. IEEE Transactions on Image Processing Vol. 30, 8727–8742, 2021.
Crossref Google Scholar
[34]
Hu, J. L.; Lu, J. W.; Tan, Y. P. Sharable and individual multi-view metric learning. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 40, No. 9, 2281–2288, 2018.
Crossref Google Scholar
[35]
Lu, Y.; Wu, Y.; Liu, B.; Zhang, T.; Li, B.; Chu, Q.; Yu, N. Cross-modality person re-identification with shared-specific feature transfer. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 13376–13386, 2020.
Crossref
[36]
Zhou, T.; Zhang, C.; Peng, X.; Bhaskar, H.; Yang, J. Dual shared-specific multiview subspace clustering. IEEE Transactions on Cybernetics Vol. 50, No. 8, 3517–3530, 2020.
Crossref Google Scholar
[37]
Zhou, T.; Fu, H. Z.; Chen, G.; Shen, J. B.; Shao, L. Hi-net: Hybrid-fusion network for multi-modal MR image synthesis. IEEE Transactions on Medical Imaging Vol. 39, No. 9, 2772–2781, 2020.
Crossref Google Scholar
[38]
Ronneberger, O.; Fischer, P.; Brox, T. U-Net: Convolutional networks for biomedical image segmentation. In: Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015. Lecture Notes in Computer Science, Vol. 9351. Navab, N.; Hornegger, J.; Wells, W.; Frangi, A. Eds. Springer Cham, 234–241, 2015.
Crossref
[39]
Zhou, T.; Fu, H.; Chen, G.; Zhou, Y.; Fan, D.-P.; Shao, L. Specificity-preserving RGB-D saliency detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, 4661–4671, 2021.
Crossref
[40]
Zhu, W. J.; Liang, S.; Wei, Y. C.; Sun, J. Saliency optimization from robust background detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2814–2821, 2014.
Crossref
[41]
Achanta, R.; Hemami, S.; Estrada, F.; Susstrunk, S. Frequency-tuned salient region detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1597–1604, 2009.
Crossref
[42]
Zhou, L.; Yang, Z. H.; Yuan, Q.; Zhou, Z. T.; Hu, D. W. Salient region detection via integrating diffusion-based compactness and local contrast. IEEE Transactions on Image Processing Vol. 24, No. 11, 3308–3320, 2015.
Crossref Google Scholar
[43]
Jiang, Z. L.; Davis, L. S. Submodular salient region detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2043–2050, 2013.
Crossref
[44]
Hou, Q. B.; Cheng, M. M.; Hu, X. W.; Borji, A.; Tu, Z. W.; Torr, P. H. S. Deeply supervised salient object detection with short connections. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 41, No. 4, 815–828, 2019.
Crossref Google Scholar
[45]
Wang, L. Z.; Wang, L. J.; Lu, H. C.; Zhang, P. P.; Ruan, X. Salient object detection with recurrent fully convolutional networks. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 41, No. 7, 1734–1746, 2019.
Crossref Google Scholar
[46]
Liu, N.; Han, J.; Yang, M. PiCANet: Learning pixel-wise contextual attention for saliency detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3089–3098, 2018.
Crossref
[47]
Deng, Z.; Hu, X.; Zhu, L.; Xu, X.; Qin, J.; Han, G.; Heng, P.-A. R3Net: Recurrent residual refinement network for saliency detection. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence, 684–690, 2018.
Crossref
[48]
Wang, W.; Lai, Q.; Fu, H.; Shen, J.; Ling, H.; Yang, R. Salient object detection in the deep learning era: An in-depth survey. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 44, No. 6, 3239–3259, 2022.
Crossref Google Scholar
[49]
Wang, X.; Ma, H.; Chen, X.; You, S. Edge preserving and multi-scale contextual neural network for salient object detection. IEEE Transactions on Image Processing Vol. 27, No. 1, 121–134, 2018.
Crossref Google Scholar
[50]
Zhang, P. P.; Wang, D.; Lu, H. C.; Wang, H. Y.; Ruan, X. Amulet: Aggregating multi-level convolutional features for salient object detection. In: Proceedings of the IEEE International Conference on Computer Vision, 202–211, 2017.
Crossref
[51]
Zhang, L.; Dai, J.; Lu, H. C.; He, Y.; Wang, G. A bi-directional message passing model for salient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 1741–1750, 2018.
Crossref
[52]
Pang, Y. W.; Zhao, X. Q.; Zhang, L. H.; Lu, H. C. Multi-scale interactive network for salient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 9410–9419, 2020.
Crossref
[53]
Lang, C.; Nguyen, T. V.; Katti, H.; Yadati, K.; Kankanhalli, M.; Yan, S. Depth matters: Influence of depth cues on visual saliency. In: Computer Vision – ECCV 2012. Lecture Notes in Computer Science, Vol. 7573. Fitzgibbon, A.; Lazebnik, S.; Perona, P.; Sato, Y.; Schmid, C. Eds. Springer Berlin Heidelberg, 101–115, 2012.
Crossref
[54]
Ju, R.; Ge, L.; Geng, W.; Ren, T.; Wu, G. Depth saliency based on anisotropic center-surround difference. In: Proceedings of the IEEE International Conference on Image Processing, 1115–1119, 2014.
Crossref
[55]
Desingh, K.; Krishna, K. M.; Rajan, D.; Jawahar, C. V. Depth really matters: Improving visual salient region detection with depth. In: Proceedings of the British Machine Vision Conference, 98.1–98.11, 2013.
Crossref
[56]
Zhu, C. B.; Li, G.; Wang, W. M.; Wang, R. G. An innovative salient object detection using center-dark channel prior. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, 1509–1515, 2017.
Crossref
[57]
Liang, F. F.; Duan, L. J.; Ma, W.; Qiao, Y. H.; Cai, Z.; Qing, L. Y. Stereoscopic saliency model using contrast and depth-guided-background prior. Neurocomputing Vol. 275, 2227–2238, 2018.
Crossref Google Scholar
[58]
Feng, D.; Barnes, N.; You, S. D.; McCarthy, C. Local background enclosure for RGB-D salient object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2343–2350, 2016.
Crossref
[59]
Qu, L. Q.; He, S. F.; Zhang, J. W.; Tian, J. D.; Tang, Y. D.; Yang, Q. X. RGBD salient object detection via deep fusion. IEEE Transactions on Image Processing Vol. 26, No. 5, 2274–2285, 2017.
Crossref Google Scholar
[60]
Piao, Y. R.; Ji, W.; Li, J. J.; Zhang, M.; Lu, H. C. Depth-induced multi-scale recurrent attention network for saliency detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, 7253–7262, 2019.
Crossref
[61]
Li, C. Y.; Cong, R. M.; Piao, Y. R.; Xu, Q. Q.; Loy, C. C. RGB-D salient object detection with cross-modality modulation and selection. In: Computer Vision – ECCV 2020. Lecture Notes in Computer Science, Vol. 12353. Vedaldi, A.; Bischof, H.; Brox, T.; Frahm, J. M. Eds. Springer Cham, 225–241, 2020.
[62]
Li, G. Y.; Liu, Z.; Ye, L. W.; Wang, Y.; Ling, H. B. Cross-modal weighting network for RGB-D salient object detection. In: Computer Vision – ECCV 2020. Lecture Notes in Computer Science, Vol. 12362. Vedaldi, A.; Bischof, H.; Brox, T.; Frahm, J. M. Eds. Springer Cham, 665–681, 2020.
[63]
Chaudhuri, K.; Kakade, S. M.; Livescu, K.; Sridharan, K. Multi-view clustering via canonical correlation analysis. In: Proceedings of the 26th Annual International Conference on Machine Learning, 129–136, 2009.
Crossref
[64]
Ding, C. X.; Tao, D. C. Robust face recognition via multimodal deep face representation. IEEE Transactions on Multimedia Vol. 17, No. 11, 2049–2058, 2015.
Crossref Google Scholar
[65]
Gönen, M.; Alpaydın, E. Multiple kernel learning algorithms. The Journal of Machine Learning Research Vol. 12, 2211–2268, 2011.
Google Scholar
[66]
White, M.; Yu, Y.; Zhang, X.; Schuurmans, D. Convex multi-view subspace learning. In: Proceedings of the 25th International Conference on Neural Information Processing Systems, Vol. 1, 1673–1681, 2012.
[67]
Zhang, C. Q.; Hu, Q. H.; Fu, H. Z.; Zhu, P. F.; Cao, X. C. Latent multi-view subspace clustering. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 4333–4341, 2017.
Crossref
[68]
Ngiam, J.; Khosla, A.; Kim, M.; Nam, J.; Lee, H.; Ng, A. Multimodal deep learning. In: Proceedings of the 28th International Conference on International Conference on Machine Learning, 689–696, 2011.
[69]
Eitel, A.; Springenberg, J. T.; Spinello, L.; Riedmiller, M.; Burgard, W. Multimodal deep learning for robust RGB-D object recognition. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, 681–687, 2015.
Crossref
[70]
Gao, S. H.; Cheng, M. M.; Zhao, K.; Zhang, X. Y.; Yang, M. H.; Torr, P. Res2Net: A new multi-scale backbone architecture. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 43, No. 2, 652–662, 2021.
Crossref Google Scholar
[71]
Russakovsky, O.; Deng, J.; Su, H.; Krause, J.; Satheesh, S.; Ma, S.; Huang, Z.; Karpathy, A.; Khosla, A.; Bernstein, M.; et al. ImageNet large scale visual recognition challenge. International Journal of Computer Vision Vol. 115, No. 3, 211–252, 2015.
Crossref Google Scholar
[72]
Wu, Z.; Su, L.; Huang, Q. M. Cascaded partial decoder for fast and accurate salient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3902–3911, 2019.
Crossref
[73]
Wei, J.; Wang, S.; Huang, Q. F3Net: Fusion, feedback and focus for salient object detection. Proceedings of the AAAI Conference on Artificial Intelligence Vol. 34, No. 7, 12321–12328, 2020.
Crossref Google Scholar
[74]
Cheng, Y. P.; Fu, H. Z.; Wei, X. X.; Xiao, J. J.; Cao, X. C. Depth enhanced saliency detection method. In: Proceedings of the International Conference on Internet Multimedia Computing and Service, 23–27, 2014.
Crossref
[75]
Li, G.; Zhu, C. B. A three-pathway psychobiological framework of salient object detection using stereo-scopic technology. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, 3008–3014, 2017.
Crossref
[76]
Niu, Y. Z.; Geng, Y. J.; Li, X. Q.; Liu, F. Leveraging stereopsis for saliency analysis. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 454–461, 2012.
[77]
Cheng, M. M.; Fan, D. P. Structure-measure: A new way to evaluate foreground maps. International Journal of Computer Vision Vol. 129, No. 9, 2622–2638, 2021.
Crossref Google Scholar
[78]
Fan, D.-P.; Gong, C.; Cao, Y.; Ren, B.; Cheng, M.-M.; Borji, A. Enhanced-alignment measure for binary foreground map valuation. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence, 698–704, 2018.
Crossref
[79]
Perazzi, F.; Krähenbühl, P.; Pritch, Y.; Hornung, A. Saliency filters: Contrast based filtering for salient region detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 733–740, 2012.
Crossref
[80]
Cong, R. M.; Lei, J. J.; Zhang, C. Q.; Huang, Q. M.; Cao, X. C.; Hou, C. P. Saliency detection for stereoscopic images based on depth confidence analysis and multiple cues fusion. IEEE Signal Processing Letters Vol. 23, No. 6, 819–823, 2016.
Crossref Google Scholar
[81]
Cong, R. M.; Lei, J. J.; Fu, H. Z.; Hou, J. H.; Huang, Q. M.; Kwong, S. Going from RGB to RGBD saliency: A depth-guided transformation model. IEEE Transactions on Cybernetics Vol. 50, No. 8, 3627–3639, 2020.
Crossref Google Scholar
[82]
Jiang, B.; Zhou, Z. T.; Wang, X.; Tang, J.; Luo, B. cmSalGAN: RGB-D salient object detection with cross-view generative adversarial networks. IEEE Transactions on Multimedia Vol. 23, 1343–1353, 2021.
Crossref Google Scholar
[83]
Li, C. Y.; Cong, R. M.; Kwong, S.; Hou, J. H.; Fu, H. Z.; Zhu, G. P.; Zhang, D.; Huang, Q. ASIF-Net: Attention steered interweave fusion network for RGB-D salient object detection. IEEE Transactions on Cybernetics Vol. 51, No. 1, 88–100, 2021.
Crossref Google Scholar
[84]
Li, G.; Liu, Z.; Ling, H. ICNet: Information conversion network for RGB-D based salient object detection. IEEE Transactions on Image Processing Vol. 29, 4873–4884, 2020.
Crossref Google Scholar
[85]
Piao, Y. R.; Rong, Z. K.; Zhang, M.; Ren, W. S.; Lu, H. C. A2dele: Adaptive and attentive depth distiller for efficient RGB-D salient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 9057–9066, 2020.
Crossref
[86]
Liu, N.; Zhang, N.; Han, J. W. Learning selective self-mutual attention for RGB-D saliency detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 13753–13762, 2020.
Crossref
[87]
Zhang, M.; Ren, W. S.; Piao, Y. R.; Rong, Z. K.; Lu, H. C. Select, supplement and focus for RGB-D saliency detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3469–3478, 2020.
Crossref
[88]
Pang, Y.; Zhang, L.; Zhao, X.; Lu, H. Hierarchical dynamic filtering network for RGB-D salient object detection. In: Computer Vision – ECCV 2020. Lecture Notes in Computer Science, Vol. 12370. Vedaldi, A.; Bischof, H.; Brox, T.; Frahm, J. M. Eds. Springer Cham, 235–252, 2020.
[89]
Luo, A.; Li, X.; Yang, F.; Jiao, Z.; Cheng, H.; Lyu, S. Cascade graph neural networks for RGB-D salient object detection. In: Computer Vision – ECCV 2020. Lecture Notes in Computer Science, Vol. 12357. Vedaldi, A.; Bischof, H.; Brox, T.; Frahm, J. M. Eds. Springe Cham, 346–364, 2020.
[90]
Ji, W.; Li, J.; Zhang, M.; Piao, Y.; Lu, H. Accurate RGB-D salient object detection via collaborative learning. In: Computer Vision – ECCV 2020. Lecture Notes in Computer Science, Vol. 12363. Vedaldi, A.; Bischof, H.; Brox, T.; Frahm, J. M. Eds. Springer Cham, 52–69, 2020.
[91]
Zhao, X.; Zhang, L.; Pang, Y.; Lu, H.; Zhang, L. A single stream network for robust and real-time RGB-D salient object detection. In: Computer Vision – ECCV 2020. Lecture Notes in Computer Science, Vol. 12367. Vedaldi, A.; Bischof, H.; Brox, T.; Frahm, J. M. Eds. Springer Cham, 646–662, 2020.
[92]
Chen, S.; Fu, Y. Progressively guided alternate refinement network for RGB-D salient object detection. In: Computer Vision – ECCV 2020. Lecture Notes in Computer Science, Vol. 12353. Vedaldi, A.; Bischof, H.; Brox, T.; Frahm, J. M. Eds. Springer Cham, 520–538, 2020.
[93]
Lin, T. Y.; Dollár, P.; Girshick, R.; He, K. M.; Hariharan, B.; Belongie, S. Feature pyramid networks for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 936–944, 2017.
Crossref
[94]
He, K. M.; Gkioxari, G.; Dollár, P.; Girshick, R. Mask R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision, 2980–2988, 2017.
[95]
Zhao, H. S.; Shi, J. P.; Qi, X. J.; Wang, X. G.; Jia, J. Y. Pyramid scene parsing network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 6230–6239, 2017.
Crossref
[96]
Qin, X. B.; Zhang, Z. C.; Huang, C. Y.; Gao, C.; Dehghan, M.; Jagersand, M. BASNet: Boundary-aware salient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 7471–7481, 2019.
Crossref
[97]
Zhao, T.; Wu, X. Q. Pyramid feature attention network for saliency detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3080–3089, 2019.
Crossref
[98]
Wu, Z.; Su, L.; Huang, Q. M. Cascaded partial decoder for fast and accurate salient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3902–3911, 2019.
Crossref
[99]
Zhao, J. X.; Liu, J. J.; Fan, D. P.; Cao, Y.; Yang, J. F.; Cheng, M. M. EGNet: Edge guidance network for salient object detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, 8778–8787, 2019.
Crossref
[100]
Fan, D.-P.; Ji, G.-P.; Cheng, M.-M.; Shao, L. Concealed object detection. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2021.
Crossref Google Scholar
[101]
Sun, Y. J.; Chen, G.; Zhou, T.; Zhang, Y.; Liu, N. Context-aware cross-level fusion network for camouflaged object detection. In: Proceedings of the 30th International Joint Conference on Artificial Intelligence, 1025–1031, 2021.
Crossref
[102]
Li, L.; Dong, B.; Rigall, E.; Zhou, T.; Dong, J. Y.; Chen, G. Marine animal segmentation. IEEE Transactions on Circuits and Systems for Video Technology Vol. 32, No. 4, 2303–2314, 2022.
Crossref Google Scholar
[103]
Zhang, J.; Lv, Y.; Xiang, M.; Li, A.; Dai, Y.; Zhong, Y. Depth confidence-aware camouflaged object detection. arXiv preprint arXiv:2106.13217, 2021.
Google Scholar
[104]
Le, T. N.; Nguyen, T. V.; Nie, Z. L.; Tran, M. T.; Sugimoto, A. Anabranch network for camouflaged object segmentation. Computer Vision and Image Understanding Vol. 184, 45–56, 2019.
Crossref Google Scholar
[105]
Fan, D.-P.; Ji, G.-P.; Sun, G.; Cheng, M.-M.; Shen, J.; Shao, L. Camouflaged object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2774–2784, 2020.
Crossref
Computational Visual Media
Volume 9 Issue 2,
June 2023
Pages 297-317
DOI: 10.1007/s41095-022-0268-6
Cite this article:
Zhou T, Fan D-P, Chen G, et al. Specificity-preserving RGB-D saliency detection. Computational Visual Media, 2023, 9(2): 297-317. https://doi.org/10.1007/s41095-022-0268-6

7695

Views

51

Downloads

5

Crossref

6

Web of Science

5

Scopus

0

CSCD

Altmetrics
Received: 19 October 2021
Accepted: 01 January 2022
Published: 03 January 2023
© The Author(s) 2022.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduc-tion in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.

The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.

To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Other papers from this open access journal are available free of charge from http://www.springer.com/journal/41095. To submit a manuscript, please go to https://www.editorialmanager.com/cvmj.
Return