Selected Publications
Journal Papers
Jialin Tian, Abdulmotaleb El Saddik, Xing Xu, Dongshuai Li, Zuo Cao, Heng Tao Shen: Intrinsic Consistency Preservation with Adaptively Reliable Samples for Source-free Domain Adaptation. (中科院JCR 1区, Corresponding author) [ code ] (中科院JCR 1区, Corresponding author)
Yixuan Zhou, Xing Xu, Jingkuan Song, Fumin Shen, and Heng Tao Shen: MSFlow: Multi-Scale Flow-based Framework for Unsupervised Anomaly Detection. IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2023. (中科院JCR 1区, Corresponding author)
Jiefu Chen, Tong Chen, Xing Xu, Jingran Zhang, Yang Yang, and Heng Tao Shen: Coreset Learning based Sparse Black-box Adversarial Attack for Video Recognition. IEEE Transactions on Information Forensics & Security, 2023. (中科院JCR 1区)
Shenshen Li, Xing Xu, Xun Jiang, Fumin Shen, Xin Liu, and Heng Tao Shen: Multi-Grained Attention Network with Mutual Exclusion for Composed Query-Based Image Retrieval. IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 2023. (中科院JCR 1区, Corresponding author) [ code ]
Xun Jiang, Xing Xu, Jingran Zhang, Fumin Shen, Zuo Cao, and Heng Tao Shen: SDN: Semantic Decoupling Network for Temporal Language Grounding. IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2022. (中科院JCR 1区, Corresponding author) [ code ]
Xing Xu, Jialiang Sun, Zuo Cao, Xiaofeng Zhu, Yin Zhang, Heng Tao Shen: TFUN: Trilinear Fusion Network for Ternary Image-Text Retrieval. Information Fusion. 2022 (中科院JCR 1区, Corresponding author) [ code ]
Gongmian Wang, Xing Xu, Fumin Shen, Huimin Lu, Yanli Ji, Heng Tao Shen: Cross-Modal Dynamic Networks for Video Moment Retrieval With Text Query. IEEE Trans. Multim. 24: 1221-1232 (2022) (中科院JCR 2区)
[ code ]
Yixuan He, Xing Xu, Jingran Zhang, Fumin Shen, Yang Yang, Heng Tao Shen: Modeling Two-Stream Correspondence for Visual Sound Separation. IEEE Trans. Circuits Syst. Video Technol. 32(5): 3291-3302 (2022) (中科院JCR 2区)
Xianda Xu, Xing Xu, Fumin Shen, Yujie Li: Semantic-Aligned Attention With Refining Feature Embedding for Few-Shot Image Classification. IEEE Trans. Intell. Transp. Syst. 23(12): 25458-25468 (2022)
Tian Wang, Xing Xu, Fumin Shen, Yang Yang: A Cognitive Memory-Augmented Network for Visual Anomaly Detection. IEEE CAA J. Autom. Sinica 8(7): 1296-1307 (2021) (中科院JCR 1区, Corresponding author)
[ code ]
Yixuan He, Xing Xu, Jingran Zhang, Fumin Shen, Yang Yang, Heng Tao Shen: Modeling Two-Stream Correspondence for Visual Sound Separation. IEEE Transactions on Circuits and Systems for Video Technology (2021) (中科院JCR 2区, Corresponding author)
Heng Tao Shen, Xiaofeng Zhu, Zheng Zhang, Shui-Hua Wang, Yi Chen, Xing Xu, Jie Shao: Heterogeneous data fusion for predicting mild cognitive impairment conversion. Information Fusion 66: 54-63 (2021) (中科院JCR 1区)
Yujie Li, Xing Xu, Jinhui Xiao, Siyuan Li, Heng Tao Shen: Adaptive Square Attack: Fooling Autonomous Cars With Adversarial Traffic Signs. IEEE Internet of Things Journal 8(8): 6337-6347 (2021) (中科院JCR 1区, Corresponding author)
Yifeng Zhou, Xing Xu, Fumin Shen, Xiaofeng Zhu, Heng Tao Shen: Flow-Edge Guided Unsupervised Video Object Segmentation. IEEE Transactions on Circuits and Systems for Video Technology (2021) (中科院JCR 2区, Corresponding author)
Huimin Lu, Ming Zhang, Xing Xu, Yujie Li, Heng Tao Shen: Deep Fuzzy Hashing Network for Efficient Image Retrieval. IEEE Transactions on Fuzzy Systems 29(1): 166-176 (2021) (中科院JCR 1区, Corresponding author, ESI Highly Cited Papers, Outstanding Paper Award)
Xing Xu, Tan Wang, Yang Yang, Alan Hanjalic, Heng Tao Shen: Radial Graph Convolutional Network for Visual Question Generation. IEEE Transactions on Neural Networks and Learning Systems 32(4): 1654-1667 (2021) (中科院JCR 1区)
[ code ]
Jiwei Wei, Yang Yang, Xing Xu, Xiaofeng Zhu, Heng Tao Shen: Universal Weighting Metric Learning for Cross-Modal Retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence (2021) (中科院JCR 1区)
[ code ]
Xiang Guan, Yang Yang, Jingjing Li, Xing Xu, Heng Tao Shen: Mind the Remainder: Taylor's Theorem View on Recurrent Neural Networks. IEEE Transactions on Neural Networks and Learning Systems (2020) (中科院JCR 1区)
Xing Xu, Kaiyi Lin, Yang Yang, Alan Hanjalic, Heng Tao Shen: Joint Feature Synthesis and Embedding: Adversarial Cross-modal Retrieval Revisited. IEEE Transactions on Pattern Analysis and Machine Intelligence (2020) (中科院JCR 1区, ESI Highly Cited Papers)
[ code ]
Jingkuan Song, Tao He, Lianli Gao, Xing Xu, Alan Hanjalic, Heng Tao Shen: Unified Binary Generative Adversarial Network for Image Retrieval and Compression. International Journal of Computer Vision 128(8): 2243-2264 (2020) (中科院JCR 1区)
Xing Xu, Kaiyi Lin, Lianli Gao, Huimin Lu, Heng Tao Shen, Xuelong Li: Learning Cross-modal Common Representations by Private-shared Subspaces Separation. IEEE Transactions on Cybernetics (2020) (中科院JCR 1区)
Xing Xu, Huimin Lu, Jingkuan Song, Yang Yang, Heng Tao Shen, Xuelong Li: Ternary Adversarial Networks With Self-Supervision for Zero-Shot Cross-Modal Retrieval. IEEE Transactions on Cybernetics 50(6): 2400-2413 (2020) (中科院JCR 1区, ESI Highly Cited Papers)
Yanli Ji, Yue Zhan, Yang Yang, Xing Xu, Fumin Shen, Heng Tao Shen: A Context Knowledge Map Guided Coarse-to-Fine Action Recognition. IEEE Transactions on Image Processing 29: 2742-2752 (2020) (中科院JCR 1区)
Jingran Zhang, Fumin Shen, Xing Xu, Heng Tao Shen: Temporal Reasoning Graph for Activity Recognition. IEEE Transactions on Image Processing 29: 5491-5506 (2020)(中科院JCR 1区)
Xing Xu, Tan Wang, Yang Yang, Lin Zuo, Fumin Shen, Heng Tao Shen: Cross-Modal Attention With Semantic Consistence for Image-Text Matching. IEEE Transactions on Neural Networks and Learning Systems 31(12): 5412-5425 (2020) (中科院JCR 1区)
[ code ]
Xing Xu, Fumin Shen, Yang Yang, Heng Tao Shen, Xuelong Li: Learning Discriminative Binary Codes for Large-scale Cross-modal Retrieval. IEEE Transactions on Image Processing 26(5): 2494-2507 (2017) (中科院JCR 1区, ESI Highly Cited Papers)
[ code ]
Conference Papers
Kai Wang, Jiayang Liu, Xing Xu, Jingkuan Song, Xin Liu, and Heng Tao Shen: Unsupevised Cross-Domain Image Retrieval with Semantic-Attended Mixture-of-Experts. The 47th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2024). (CCF A, Corresponding author)
Quanxing Zha, Xin Liu, Yiu-Ming Cheung, Xing Xu, Nannan Wang and Jianjia Cao: UGNCL: Uncertainty-Guided Noisy Correspondence Learning for Efficient Cross-Modal Matching. The 47th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2024). (CCF A)
Zixian Gao, Xun Jiang, Xing Xu, Fumin Shen, Yujie Li, and Heng Tao Shen: Embracing Unimodal
Aleatoric Uncertainty for Robust Multimodal Fusion. IEEE/CVF Computer Vision and Pattern Recognition Conference (CVPR 2024). (CCF A, Corresponding author)
Shenshen Li, Chen He, Xing Xu, Fumin Shen, Yang Yang, and Heng Tao Shen: Adaptive Uncertainty-based Learning for Text-based Person Retrieval. Thirty-Eighth AAAI Conference on Artificial Intelligence (AAAI 2024). (CCF A, Corresponding author) [ code ]
Lei Wang, Yi Hu, Jiabang He, Xing Xu, Ning Liu, Hui Liu, and Heng Tao Shen: T-SciQ: Teaching Multimodal Chain-of-Thought Reasoning via Large Language Model Signals for Science Question Answering. Thirty-Eighth AAAI Conference on Artificial Intelligence (AAAI 2024). (CCF A) [ code ]
Shenshen Li, Xing Xu, Yang Yang, Fumin Shen, Yijun Mo, Yujie Li, Heng Tao Shen: DCEL: Deep Cross-Modal Evidential Learning for Text-Based Person Retrieval. ACM International Conference on Multimedia (ACM MM), 2023. (CCF A, Corresponding author) [ code ]
Zhiguo Chen, Xun Jiang, Xing Xu, Zuo Cao, Yijun Mo, Heng Tao Shen: Joint Searching and Grounding: Multi-Granularity Video Content Retrieval. ACM International Conference on Multimedia (ACM MM), 2023. (CCF A, Corresponding author) [ code ]
Xun Jiang, Zailei Zhou, Xing Xu, Yang Yang, Guoqing Wang, Heng Tao Shen: Faster Video Moment Retrieval with Point-Level Supervision. ACM International Conference on Multimedia (ACM MM), 2023. (CCF A, Corresponding author) [ code ]
Guancheng Chen, Xin Liu, Xing Xu, Yiu-ming Cheung, Taihao Li: Taking a Part for the Whole: An Archetype-agnostic Framework for Voice-Face Association. ACM International Conference on Multimedia (ACM MM), 2023.
Yixuan Zhou, Yi Qu, Xing Xu, Heng Tao Shen: ImbSAM: A Closer Look at Sharpness-Aware Minimization in Class-Imbalanced Recognition. International Conference on Computer Vision (ICCV), 2023. (CCF A, Corresponding author)
Jiabang He, Lei Wang, Yi Hu, Ning Liu, Hui Liu, Xing Xu, Heng Tao Shen: ICL-D3IE: In-Context Learning with Diverse Demonstrations Updating for Document Information Extraction. International Conference on Computer Vision (ICCV), 2023. (CCF A, Corresponding author)
Jiabang He, Yi Hu, Lei Wang, Xing Xu, Ning Liu, Hui Liu and Heng Tao Shen: Do-GOOD: Towards Distribution Shift Evaluation for Pre-Trained Visual Document Understanding Models. The 46th International ACM SIGIR Conference on Research and Development (SIGIR) 2023 (CCF A, Corresponding author) [ code ]
Lei Wang, Jiabang He, Xing Xu, Ning Liu and Hui Liu: Alignment-Enriched Tuning for Patch-Level Pre-trained Document Image Models. Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI) 2023 (CCF A, Corresponding author) [ code ]
Kai Wang, Yifan Wang, Xing Xu, Xin Liu, Weihua Ou, Huimin Lu:
Prototype-based Selective Knowledge Distillation for Zero-Shot Sketch Based Image Retrieval. ACM Multimedia 2022: 601-609 (CCF A, Corresponding author)
Siyuan Li, Xing Xu, Zailei Zhou, Yang Yang, Guoqing Wang, Heng Tao Shen: ARRA: Absolute-Relative Ranking Attack against Image Retrieval. ACM Multimedia 2022: 610-618 (CCF A)
Xun Jiang, Xing Xu, Zhiguo Chen, Jingran Zhang, Jingkuan Song, Fumin Shen, Huimin Lu, Heng Tao Shen: DHHN: Dual Hierarchical Hybrid Network for Weakly-Supervised Audio-Visual Video Parsing. ACM Multimedia 2022: 719-727 (CCF A)
Zeyu Ma, Yang Yang, Guoqing Wang, Xing Xu, Heng Tao Shen, Mingxing Zhang:
Rethinking Open-World Object Detection in Autonomous Driving Scenarios. ACM Multimedia 2022: 1279-1288 (CCF A)
Zheng Wang, Zhenwei Gao, Xing Xu, Yadan Luo, Yang Yang, Heng Tao Shen: Point to Rectangle Matching for Image Text Retrieval. ACM Multimedia 2022: 4977-4986 (CCF A)
Jialin Tian, Kai Wang, Xing Xu, Zuo Cao, Fumin Shen, Heng Tao Shen: Multimodal Disentanglement Variational AutoEncoders for Zero-Shot Cross-Modal Retrieval. The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) 2022 (CCF A, Corresponding author)
Jialin Tian, Xing Xu, Kai Wang, Zuo Cao, Xunliang Cai, Heng Tao Shen: Structure-Aware Semantic-Aligned Network for Universal Cross-Domain Retrieval. The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) 2022 (CCF A, Corresponding author)
Xun Jiang, Xing Xu, Jingran Zhang, Fumin Shen, Zuo Cao, Heng Tao Shen: Semi-supervised Video Paragraph Grounding with Contrastive Encoder. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2022 (CCF A, Corresponding author)
Jialin Tian, Xing Xu, Fumin Shen, Yang Yang, Heng Tao Shen: TVT: Three-Way Vision Transformer through Multi-Modal Hypersphere Learning for Zero-Shot Sketch-Based Image Retrieval. AAAI Conference on Artificial Intelligence (AAAI) 2022 (CCF A, Corresponding author) [ code ]
Yuyu Guo, Lianli Gao, Xuanhan Wang, Xing Xu, Xu Lu, Heng Tao Shen, Jingkuan Song: From General to Specific: Informative Scene Graph Generation via Balance Adjustment. International Conference on Computer Vision (ICCV) 2021 (CCF A)
Xiang Guan, Guoqing Wang, Xing Xu, Yi Bin: Learning Hierarchical Channel Attention for Fine-grained Visual Classification. ACM International Conference on Multimedia 2021 (CCF A)
Jiwei Wei, Xing Xu, Zheng Wang, Guoqing Wang: Meta Self-Paced Learning for Cross-Modal Matching. ACM International Conference on Multimedia 2021 (CCF A, Corresponding author)
Jingran Zhang, Xing Xu, Fumin Shen, Yazhou Yao, Jie Shao, Xiaofeng Zhu: Video Representation Learning with Graph Contrastive Augmentation. ACM International Conference on Multimedia 2021 (CCF A, Corresponding author)
Chuanyi Zhang, Yazhou Yao, Xing Xu, Jie Shao, Jingkuan Song, Zechao Li, Zhengmin Tang. Extracting Useful Knowledge form Noisy Web Images via Data Purification for Fine-Grained Recognition. ACM International Conference on Multimedia 2021 (CCF A)
Shuo Ma, Yanli Ji, Xing Xu, Xiaofeng Zhu: Vision-guided Music Source Separation via a Fine-grained Cycle-Separation Network. ACM International Conference on Multimedia 2021 (CCF A)
Yifan Ren, Xing Xu, Fumin Shen, Yazhou Yao, Huimin Lu: CAA: Candidate-Aware Aggregation for Temporal Action Detection. ACM International Conference on Multimedia 2021 (CCF A, Corresponding author)
Guoqing Wang, Changming Sun, Xing Xu, Jingjing Li, Zheng Wang, Zeyu Ma: Disentangled Representation Learning and Enhancement Network for Single Image De-Raining, ACM International Conference on Multimedia 2021 (CCF A)
Jialin Tian, Xing Xu, Zheng Wang, Fumin Shen, Xin Liu: Relationship-Preserving Knowledge Distillation for Zero-Shot Sketch Based Image Retrieval. ACM International Conference on Multimedia 2021 (CCF A, Corresponding autho)
Jingran Zhang, Xing Xu, Fumin Shen, Huimin Lu, Xin Liu, Heng Tao Shen: Enhancing Audio-Visual Association with Self-Supervised Curriculum Learning. AAAI Conference on Artificial Intelligence 2021: 3351-3359 (CCF A, Corresponding author)
Mingxing Zhang, Yang Yang, Xinghan Chen, Yanli Ji, Xing Xu, Jingjing Li, Heng Tao Shen: Multi-Stage Aggregated Transformer Network for Temporal Language Localization in Videos. IEEE Conference on Computer Vision and Pattern Recognition 2021: 12669-12678 (CCF A)
Yangye Fu, Ming Zhang, Xing Xu, Zuo Cao, Chao Ma, Yanli Ji, Kai Zuo, Huimin Lu: Partial Feature Selection and Alignment for Multi-Source Domain Adaptation. IEEE Conference on Computer Vision and Pattern Recognition 2021: 16654-16663 (CCF A, Corresponding author)
Lianli Gao, Yaya Cheng, Qilong Zhang, Xing Xu, Jingkuan Song: Feature Space Targeted Attacks by Statistic Alignment. International Joint Conference on Artificial Intelligence 2021: 671-677 (CCF A)
Yiran Zhu, Xing Xu, Fumin Shen, Yanli Ji, Lianli Gao, Heng Tao Shen: PoseGTAC: Graph Transformer Encoder-Decoder with Atrous Convolution for 3D Human Pose Estimation. International Joint Conference on Artificial Intelligence 2021: 1359-1365 (CCF A, Corresponding author)
Jiao Li, Xing Xu, Wei Yu, Fumin Shen, Zuo Cao, Kai Zuo, Heng Tao Shen: Hybrid Fusion with Intra- and Cross-Modality Attention for Image-Recipe Retrieval. International Conference on Research on Development in Information Retrieval 2021: 244-254 (CCF A, Corresponding author)
Kaiyi Lin, Xing Xu, Lianli Gao, Zheng Wang, Heng Tao Shen: Learning Cross-Aligned Latent Embeddings for Zero-Shot Cross-Modal Retrieval. AAAI Conference on Artificial Intelligence 2020: 11515-11522 (CCF A, Corresponding author)
Xing Xu, Jiefu Chen, Jinhui Xiao, Lianli Gao, Fumin Shen, Heng Tao Shen: What Machines See Is Not What They Get: Fooling Scene Text Recognition Models With Adversarial Text Images. IEEE Conference on Computer Vision and Pattern Recognition 2020: 12301-12311 (CCF A)
Jiwei Wei, Xing Xu, Yang Yang, Yanli Ji, Zheng Wang, Heng Tao Shen: Universal Weighting Metric Learning for Cross-Modal Matching. IEEE Conference on Computer Vision and Pattern Recognition 2020: 13002-13011 (CCF A, Corresponding author)
Kai Cheng, Xin Liu, Yiu-ming Cheung, Rui Wang, Xing Xu, Bineng Zhong: Hearing like Seeing: Improving Voice-Face Interactions and Associations via Adversarial Deep Semantic Matching Network. ACM International Conference on Multimedia 2020: 448-455 (CCF A)
Yifeng Zhou, Xing Xu, Fumin Shen, Lianli Gao, Huimin Lu, Heng Tao Shen: Temporal Denoising Mask Synthesis Network for Learning Blind Video Temporal Consistency. ACM International Conference on Multimedia 2020: 475-483 (CCF A, Corresponding author)
Xing Xu, Jiefu Chen, Jinhui Xiao, Zheng Wang, Yang Yang, Heng Tao Shen: Learning Optimization-based Adversarial Perturbations for Attacking Sequential Recognition Models. ACM International Conference on Multimedia 2020: 2802-2822 (CCF A)
Jingkuan Song, Ruimin Lang, Xiaosu Zhu, Xing Xu, Lianli Gao, Heng Tao Shen: 3D Self-Attention for Unsupervised Video Quantization. International Conference on Research on Development in Information Retrieval 2020: 1061-1070 (CCF A)
Xing Xu, Kaiyi Lin, Huimin Lu, Lianli Gao, Heng Tao Shen: Correlated Features Synthesis and Alignment for Zero-shot Cross-modal Retrieval: International Conference on Research on Development in Information Retrieval 2020: 1419-1428 (CCF A)
Lei Wang, Dongxiang Zhang, Jipeng Zhang, Xing Xu, Lianli Gao, Bing Tian Dai, Heng Tao Shen: Template-Based Math Word Problem Solvers with Recursive Neural Networks. AAAI Conference on Artificial Intelligence 2019: 7144-7151 (CCF A)
Lianli Gao, Daiyuan Chen, Jingkuan Song, Xing Xu, Dongxiang Zhang, Heng Tao Shen: Perceptual Pyramid Adversarial Networks for Text-to-Image Synthesis. AAAI Conference on Artificial Intelligence 2019: 8312-8319 (CCF A)
Lianli Gao, Kaixuan Fan, Jingkuan Song, Xianglong Liu, Xing Xu, Heng Tao Shen: Deliberate Attention Networks for Image Captioning. AAAI Conference on Artificial Intelligence 2019: 8320-8327 (CCF A)
Yaping Zhang, Shuai Nie, Wenju Liu, Xing Xu, Dongxiang Zhang, Heng Tao Shen: Sequence-To-Sequence Domain Adaptation Network for Robust Text Image Recognition. IEEE Conference on Computer Vision and Pattern Recognition 2019: 2740-2749 (CCF A)
Tan Wang, Xing Xu, Yang Yang, Alan Hanjalic, Heng Tao Shen, Jingkuan Song: Matching Images and Text with Multi-modal Tensor Fusion and Re-ranking. ACM International Conference on Multimedia 2019: 12-20 (CCF A, Corresponding author)
[ code ]
Jingyi Zhang, Zhen Wei, Ionut Cosmin Duta, Fumin Shen, Li Liu, Fan Zhu, Xing Xu, Ling Shao, Heng Tao Shen: Generative Reconstructive Hashing for Incomplete Video Analysis. ACM International Conference on Multimedia 2019: 845-854 (CCF A)
Xiangpeng Li, Lianli Gao, Xuanhan Wang, Wu Liu, Xing Xu, Heng Tao Shen, Jingkuan Song: Learnable Aggregating Net with Diversity Learning for Video Question Answering. ACM International Conference on Multimedia 2019: 1166-1174 (CCF A)
Jingkuan Song, Tao He, Lianli Gao, Xing Xu, Alan Hanjalic, Heng Tao Shen: Binary Generative Adversarial Networks for Image Retrieval. AAAI Conference on Artificial Intelligence 2018: 394-401 (CCF A)
Jingkuan Song, Tao He, Lianli Gao, Xing Xu, Heng Tao Shen: Deep Region Hashing for Generic Instance Search from Images: AAAI Conference on Artificial Intelligence 2018: 402-409 (CCF A)
Teng Long, Xing Xu, Youyou Li, Fumin Shen, Jingkuan Song, Heng Tao Shen: Pseudo Transfer with Marginalized Corrupted Attribute for Zero-shot Learning. ACM International Conference on Multimedia 2018: 1802-1810 (CCF A, Corresponding author)
Jingkuan Song, Zhilong Zhou, Lianli Gao, Xing Xu, Heng Tao Shen: Cumulative Nets for Edge Detection. ACM International Conference on Multimedia 2018: 1847-1855 (CCF A)
Xing Xu, Fumin Shen, Yang Yang, Dongxiang Zhang, Heng Tao Shen, Jingkuan Song: Matrix Tri-Factorization with Manifold Regularizations for Zero-Shot Learning. IEEE Conference on Computer Vision and Pattern Recognition 2017: 2007-2016 (CCF A) [ code ]
Bokun Wang, Yang Yang, Xing Xu, Alan Hanjalic and Heng Tao Shen: Adversarial Cross-Modal Retrieval. ACM International Conference on Multimedia (ACM Multimedia), pages 154-162, 2017 (CCF A, Best Paper Award)
[ code ]
|