Xuemeng Song
    Research Fellow
    Department of Data Science
    City University of Hong Kong
    Address： City University of Hong Kong, Tat Chee Avenue, Kowloon, Hong Kong
    Email： sxmustc at gmail dot com
News Biography Awards Services Publications Research
News
Opening for master/PhD students: I will be joining the Southern University of Science and Technology in 2025. I am recruiting self-motivated master/PhD students to collaborate on research domains such as information retrieval and multimodal large language models. (Enrollment of 2026 Sep).
Biography
Xuemeng Song is a research fellow at City University of Hong Kong, and IEEE senior member. She got her PhD degree from National University of Singapore (NUS) and her Bacherlor degree from Universitiy of Science and Technology of China (USTC) in 2016 and 2012, respectively. Her research interests are information retrieval and social media analysis. She has published more than 70 papers in the top venues (e.g., IEEE TIP, IEEE TMM, ACM SIGIR, ACM MM, and ACM TOIS) and 4 books by Morgan & Claypool Publishers and Springer. In addition, she has served as reviewers for many top conferences and journals, such as TKDD, TMM, ICMR, and MMM.

近几年来，宋雪萌博士在信息检索和多媒体分析领域展开了一系列基础研究工作，取得了较好的研究积累。其在中国计算机学会推荐的国内外著名学术期刊与会议上发表论文90余篇，出版学术专著4部。据Google Scholar统计，其已发表论文共计被引用4000余次，h-index为37。 担任国际期刊IEEE TCSVT, TMM, Netural Networks, IET Image Processing编委（AE）。同时，受到多项科研奖励，如2021年山东省科学技术进步一等奖，2023年山东省技术发明一等奖，2022年AI 2000多媒体领域最具影响力学者提名奖(AMiner)，入选2022年全球AI华人青年学者榜单（百度），入选2023年AI华人女性青年学者榜单（百度）。 主持国家自然科学基金面上项目、青年项目、科技部重点研发计划子课题、山东省优秀青年基金、山东大学未来计划青年学者、阿里巴巴AIR计划等。

  • Google Scholar: https://scholar.google.com/citations?user=29gP4okAAAAJ&hl=en
  • DBLP: https://dblp.org/pid/147/9141.html
    • Awards
  • 2022, Global Top Chinese Young Scholars in Artificial Intelligence, Baidu
  • 2022, Fellow of 2022 Women in AI, AMiner (Only 23 Chinese Women Scholars)
  • 2022, AI 2000 Most Influential Scholar Award Honorable Mention, AMiner
  • 2021, First Prize of Science and Technology Progress Award, Shandong Province of China
  • 2021, Best Paper Honorable Mention, ChinaMM
  • 2018, Future Talent Scholars, Shandong University
    •
    Services
  • Tutorial Co-Chair of the ACM ICMR, 2025
  • Action Editor of Neural Networks since 2025
  • Associate Editor for IEEE TMM since 2024
  • Associate Editor for IEEE TCSVT since 2023
  • Associate Editor for IET Image Processing since 2023
  • Chair of the ACM MM workshop on “Multimedia Computing towards Fashion Recommendation”, 2022
  • Invited keynote speaker of the workshop "Towards a Complete Analysis of People: From Face and Body to Clothes (T-CAP)" on ICIAP, 2022
  • Guest editor of the special issue “Research on multimodal representation learning with pretraining” for the Journal of Software, 2022
  • Invited speaker of the CCF-TCVRV (The sixth forum at Wuhan Textile University), 2021
  • Participate in the course construction of "Exploration of demonstration teaching on pattern recognition" of college artificial intelligence teaching resources construction project of the Ministry of Education, 2020
  • Guest editor of the special issue “Deep Learning for Multi-modal Social Media Analysis and Applications” for the journal Information Processing and Management, 2018
  • Editor board member of the journal Information Processing and Management since 2018
  • Program committee member of top conferences such as ACM SIGIR, MM, SIGKDD, WSDM, AAAI, IJCAI, and reviewers for top journals, such as ACM TOIS, IEEE TMM, IEEE TIP, and IEEE TKDE.
    • Publications
    1. Advanced Multimodal Compatibility Modeling and Recommendation.
      Weili Guan, Xuemeng Song, Dongliang Zhou, Liqiang Nie. Synthesis Lectures on Information Concepts, Springer Nature, 2025.
    2. TR-Adapter: Parameter-Efficient Transfer Learning for Video Question Answering.
      Yuanyuan Wang, Meng Liu, Xuemeng Song, Liqiang Nie. IEEE TMM, 2025.
    3. Interactive Garment Recommendation with User in the Loop.
      Federico Becattini, Xiaolin Chen, Andrea Puccia, Haokun Wen, Xuemeng Song, Liqiang Nie, Alberto Del Bimbo. ACM ToMM, 2025.
    4. Domain-aware Multimodal Dialog Systems with Distribution-based User Characteristic Modeling.
      Xiaolin Chen, Xuemeng Song, Jianhui Zuo, Yinwei Wei, Liqiang Nie, Tat-Seng Chua. ACM ToMM, 2025.
    5. Content-aware Balanced Spectrum Encoding in Masked Modeling for Time Series Classification.
      Yudong Han, Haocong Wang, Yupeng Hu, Yongshun Gong, Xuemeng Song, Weili Guan. In AAAI, 2025.
    6. Prompt-based and weak-modality enhanced multimodal recommendation.
      Xue Dong, Xuemeng Song, Minghui Tian, Linmei Hu. Inf. Fusion, 2024.
    7. Multimodal matching-aware co-attention networks with mutual knowledge distillation for fake news detection.
      Linmei Hu, Ziwang Zhao, Weijian Qi, Xuemeng Song, Liqiang Nie. Inf. Fusion, 2024.
    8. Self-Training Boosted Multi-Factor Matching Network for Composed Image Retrieval.
      Haokun Wen, Xuemeng Song, Jianhua Yin, Jianlong Wu, Weili Guan, Liqiang Nie. IEEE TPAMI, 2024
    9. Query-Oriented Micro-Video Summarization.
      Mengzhao Jia, Yinwei Wei, Xuemeng Song, Teng Sun, Min Zhang, Liqiang Nie. IEEE TPAMI, 2024
    10. Audio-Semantic Enhanced Pose-Driven Talking Head Generation.
      Meng Liu, Da Li, Yongqiang Li, Xuemeng Song, Liqiang Nie. IEEE TCSVT, 2024
    11. Muti-Modal Emotion Recognition via Hierarchical Knowledge Distillation.
      Teng Sun, Yinwei Wei, Juntong Ni, Zixin Liu, Xuemeng Song, Yaowei Wang, Liqiang Nie. IEEE TMM, 2024
    12. Xue Dong, Xuemeng Song, Na Zheng, Jianlong Wu, Hongjun Dai, Liqiang Nie.
      TryonCM2: Try-on-Enhanced Fashion Compatibility Modeling Framework. IEEE TNNLS, 2024
    13. Stylized Data-to-text Generation: A Case Study in the E-Commerce Domain.
      Liqiang Jing, Xuemeng Song, Xuming Lin, Zhongzhou Zhao, Wei Zhou, Liqiang Nie. ACM TOIS, 2024
    14. Multimodal Dialog Systems with Dual Knowledge-enhanced Generative Pretrained Language Model.
      Xiaolin Chen, Xuemeng Song, Liqiang Jing, Shuo Li, Linmei Hu, Liqiang Nie. ACM TOIS, 2024
    15. Breaking Through the Noisy Correspondence: A Robust Model for Image-Text Matching.
      Haitao Shi, Meng Liu, Xiaoxuan Mu, Xuemeng Song, Yupeng Hu, Liqiang Nie. ACM TOIS, 2024
    16. Universal Relocalizer for Weakly Supervised Referring Expression Grounding.
      Panpan Zhang, Meng Liu, Xuemeng Song, Da Cao, Zan Gao, Liqiang Nie. ACM ToMM, 2024
    17. Harnessing Representative Spatial-Temporal Information for Video Question Answering.
      Yuanyuan Wang, Meng Liu, Xuemeng Song, Liqiang Nie. ACM ToMM, 2024
    18. Similarity-Induced Weighted Consensus Laplacian Matrix Learning for Multiview Clustering.
      Hui Liu, Xiao Yu, Yuxiu Lin, Xuemeng Song, Liqiang Nie. IEEE Trans. Syst. Man Cybern. Syst, 2024
    19. Exploiting the Social-Like Prior in Transformer for Visual Reasoning.
      Yudong Han, Yupeng Hu, Xuemeng Song, Haoyu Tang, Mingzhu Xu, Liqiang Nie. In AAAI, 2024
    20. VK-G2T: Vision and Context Knowledge Enhanced Gloss2text.
      Liqiang Jing, Xuemeng Song, Xinxing Zu, Na Zheng, Zhongzhou Zhao, Liqiang Nie. In ICASSP, 2024
    21. Multi-Factor Adaptive Vision Selection for Egocentric Video Question Answering.
      Haoyu Zhang, Meng Liu, Zixin Liu, Xuemeng Song, Yaowei Wang, Liqiang Nie. In ICML, 2024
    22. Simple but Effective Raw-Data Level Multimodal Fusion for Composed Image Retrieval.
      Haokun Wen, Xuemeng Song, Xiaolin Chen, Yinwei Wei, Liqiang Nie, Tat-Seng Chua. In SIGIR, 2024
    23. Fine-grained Textual Inversion Network for Zero-Shot Composed Image Retrieval.
      Haoqiang Lin, Haokun Wen, Xuemeng Song, Meng Liu, Yupeng Hu, Liqiang Nie. In SIGIR, 2024
    24. Egocentric Early Action Prediction via Multimodal Transformer-Based Dual Action Prediction.
      Weili Guan, Xuemeng Song, Kejie Wang, Haokun Wen, Hongda Ni, Yaowei Wang, Xiaojun Chang. IEEE TCSVT, 2023.
    25. Adaptive Collaborative Soft Label Learning for Unsupervised Multi-View Feature Selection.
      Dan Shi, Lei Zhu, Xiao Dong, Xuemeng Song, Jingjing Li, Zhiyong Cheng. ACM TKDD, 2023.
    26. ROLE: Rotated Lorentzian Graph Embedding Model for Asymmetric Proximity.
      Shanshan Feng, Lisi Chen, Kaiqi Zhao, Wei Wei, Xuemeng Song, Shuo Shang, Panos Kalnis, Ling Shao. IEEE TKDE, 2023.
    27. MM-FRec: Multi-Modal Enhanced Fashion Item Recommendation.
      Xuemeng Song, Chun Wang, Changchang Sun, Shanshan Feng, Min Zhou, Liqiang Nie. IEEE TKDE, 2023.
    28. Dual Consistency-Enhanced Semi-Supervised Sentiment Analysis Towards COVID-19 Tweets.
      Teng Sun, Liqiang Jing, Yinwei Wei, Xuemeng Song, Zhiyong Cheng, Liqiang Nie. IEEE TKDE, 2023.
    29. DualGNN: Dual Graph Neural Network for Multimedia Recommendation.
      Qifan Wang, Yinwei Wei, Jianhua Yin, Jianlong Wu, Xuemeng Song, Liqiang Nie. IEEE TMM, 2023.
    30. Modality-Oriented Graph Learning Toward Outfit Compatibility Modeling.
      Xuemeng Song, Shi-Ting Fang, Xiaolin Chen, Yinwei Wei, Zhongzhou Zhao, Liqiang Nie. IEEE TMM, 2023.
    31. DualGNN: Dual Graph Neural Network for Multimedia Recommendation.
      Qifan Wang, Yinwei Wei, Jianhua Yin, Jianlong Wu, Xuemeng Song, Liqiang Nie. IEEE TMM, 2023.
    32. Dual Preference Distribution Learning for Item Recommendation.
      Xue Dong, Xuemeng Song, Na Zheng, Yinwei Wei, Zhongzhou Zhao. ACM TOIS, 2023.
    33. DBiased-P: Dual-Biased Predicate Predictor for Unbiased Scene Graph Generation.
      Xianjing Han, Xuemeng Song, Xingning Dong, Yinwei Wei, Meng Liu, Liqiang Nie. IEEE TMM, 2023.
    34. Egocentric Early Action Prediction via Adversarial Knowledge Distillation.
      Na Zheng, Xuemeng Song, Tianyu Su, Weifeng Liu, Yan Yan, Liqiang Nie. ACM ToMM, 2023.
    35. Egocentric Early Action Prediction via Adversarial Knowledge Distillation.
      Na Zheng, Xuemeng Song, Tianyu Su, Weifeng Liu, Yan Yan, Liqiang Nie. ACM ToMM, 2023.
    36. Mutual-Enhanced Incongruity Learning Network for Multi-Modal Sarcasm Detection.
      Yang Qiao, Liqiang Jing, Xuemeng Song, Xiaolin Chen, Lei Zhu, Liqiang Nie. In AAAI, 2023.
    37. Multi-source Semantic Graph-based Multimodal Sarcasm Explanation Generation.
      Liqiang Jing, Xuemeng Song, Kun Ouyang, Mengzhao Jia, Liqiang Nie. In ACL, 2023.
    38. Target-Guided Composed Image Retrieval.
      Haokun Wen, Xian Zhang, Xuemeng Song, Yinwei Wei, Liqiang Nie. In ACM MM, 2023.
    39. Adapting Generative Pretrained Language Model for Open-domain Multimodal Sentence Summarization.
      Dengtian Lin, Liqiang Jing, Xuemeng Song, Meng Liu, Teng Sun, Liqiang Nie. In SIGIR, 2023.
    40. Dual Semantic Knowledge Composed Multimodal Dialog Systems.
      Xiaolin Chen, Xuemeng Song, Yinwei Wei, Liqiang Nie, Tat-Seng Chua. In SIGIR, 2023.
    41. OFAR: A Multimodal Evidence Retrieval Framework for Illegal Live-streaming Identification.
      Dengtian Lin, Yang Ma, Yuhong Li, Xuemeng Song, Jianlong Wu, Liqiang Nie. In SIGIR, 2023.
    42. Graph Learning for Fashion Compatibility Modeling.
      Weili Guan, Xuemeng Song, Xiaojun Chang, Liqiang Nie. Synthesis Lectures on Information Concepts, Retrieval, and Services. Springer Nature, 2022.
    43. Answer Questions with Right Image Regions: A Visual Attention Regularization Approach.
      Yibing Liu, Yangyang Guo, Jianhua Yin, Xuemeng Song, Weifeng Liu, Liqiang Nie, Min Zhang. ACM TOMM, 2022.
    44. Counterfactual Reasoning for Out-of-distribution Multimodal Sentiment Analysis.
      Teng Sun, Wenjie Wang, Liqiang Jing, Yiran Cui, Xuemeng Song, Liqiang Nie. In ACM MM, 2022. (Full Paper).
    45. Bi-directional Heterogeneous Graph Hashing towards Efficient Outfit Recommendation.
      Weili Guan, Xuemeng Song, Haoyu Zhang, Meng Liu, Chung-Hsing Yeh, Xiaojun Chang. In ACM MM, 2022. (Full Paper).
    46. Divide-and-Conquer Predictor for Unbiased Scene Graph Generation
      Xianjing Han, Xingning Dong, Xuemeng Song, Tian Gan, Yibing Zhan, Yan Yan, Liqiang Nie. IEEE TCSVT, 2022.
    47. DBiased-P: Dual-Biased Predicate Predictor for Unbiased Scene Graph Generation
      Xianjing Han, Xuemeng Song, Xingning Dong, Yinwei Wei, Meng Liu, Liqiang Nie. IEEE TMM, 2022.
    48. V2P: Vision-to-Prompt based Multi-Modal Product Summary Generation.
      Xuemeng Song, Liqiang Jing, Dengtian Lin, Zhongzhou Zhao, Haiqing Chen, Liqiang Nie. In ACM SIGIR, 2022. (Full Paper). Code
    49. Personalized Fashion Compatibility Modeling via Metapath-guided Heterogeneous Graph Learning.
      Weili Guan, Fangkai Jiao, Xuemeng Song, Haokun Wen, Chung-Hsing Yeh and Xiaojun Chang. In ACM SIGIR, 2022. (Full Paper)
    50. Stacked Hybrid-Attention and Group Collaborative Learning for Unbiased Scene Graph Generation.
      Xingning Dong, Tian Gan, Xuemeng Song, Jianlong Wu, Yuan Cheng, Liqiang Nie. In CVPR, 2022.
    51. MERIt: Meta-Path Guided Contrastive Learning for Logical Reasoning.
      Fangkai Jiao, Yangyang Guo, Xuemeng Song, Liqiang Nie. In ACL, 2022.
    52. Response Generation by Jointly Modeling Personalized Linguistic Styles and Emotions.
      Teng Sun, Chun Wang, Xuemeng Song, Fuli Feng, Liqiang Nie. ACM TOMM, 2022.
    53. Modality-Oriented Graph Learning Toward Outft Compatibility Modeling.
      Xuemeng Song, Shiting Fang, Xiaolin Chen, Yinwei Wei, Zhongzhou Zhao, Liqiang Nie. TMM, 2021. Pdf   Code
    54. Collocation and Try-on Network: Whether an outfit is compatible.
      Na Zheng, Xuemeng Song, Qingying Niu, Xue Dong, Yibing Zhan, Liqiang Nie. In ACM MM, 2021. (Full Paper) Pdf
    55. Complementary Factorization towards Outfit Compatibility Modeling.
      Tianyu Su, Xuemeng Song, Na Zheng, Weili Guan, Yan Li, Liqiang Nie. In ACM MM, 2021. (Full Paper) Pdf
    56. Multimodal Compatibility Modeling via Exploring the Consistent and Complementary Correlations.
      Weili Guan, Haokun Wen, Xuemeng Song, Chung-Hsing Yeh, Xiaojun Chang, Liqiang Nie. In ACM MM, 2021. (Full Paper) Pdf
    57. Comprehensive Linguistic-Visual Composition Network for Image Retrieval.
      Haokun Wen, Xuemeng Song, Xin Yang, Yibing Zhan, Liqiang Nie. In SIGIR, 2021. (Full Paper) Pdf   Code
    58. Adversarial-Enhanced Hybrid Graph Network for User Identity Linkage.
      Xiaolin Chen, Xuemeng Song, Guozhen Peng, Shanshan Feng, Liqiang Nie. In SIGIR, 2021. (Full Paper) Pdf
    59. Multimodal Activation: Awakening Dialog Robots without Wake Words.
      Liqiang Nie, Mengzhao Jia, Xuemeng Song, Ganglu Wu, Harry Cheng, and Jian Gu. In SIGIR, 2021. (Full Paper) Pdf
    60. Fine-Grained Privacy Detection with Graph-Regularized Hierarchical Attentive Representation Learning.
      Xiaolin Chen, Xuemeng Song, Ruiyang Ren, Lei Zhu, Zhiyong Cheng, Liqiang Nie. ACM Trans. Inf. Syst. 38(4): 37:1-37:26, 2020. Pdf
    61. Auxiliary Template-Enhanced Generative Compatibility Modeling.
      Jinhuan Liu, Xuemeng Song, Zhaochun Ren, Liqiang Nie, Zhaopeng Tu, Jun Ma. In IJCAI, 2020. (Full Paper) Pdf
    62. MGCM: Multi-modal generative compatibility modeling for clothing matching.
      Jinhuan Liu, Xuemeng Song, Zhumin Chen, Jun Ma. Neurocomputing 414: 215-224, 2020. Pdf
    63. Multi-modal Try-on-guided Fashion Compatibility Modelin.
      Xue Dong, Jianlong Wu, Xuemeng Song, Hongjun Dai, Liqiang Nie. In SIGIR, 2020. (Full Paper) Pdf
    64. Generative Attribute Manipulation Scheme for Flexible Fashion Search.
      Xin Yang, Xuemeng Song, Xianjing Han, Haokun Wen, Jie Nie, Liqiang Nie. In SIGIR, 2020. (Full Paper) Pdf
    65. Large-Scale Question Tagging via Joint Question-Topic Embedding Learning.
      Liqiang Nie, Yongqi Li, Fuli Feng, Xuemeng Song, Meng Wang, Yinglong Wang. ACM Trans. Inf. Syst. 38(2): 20:1-20:23, 2020. Pdf
    66. Compatibility Modeling: Data and Knowledge Applications for Clothing Matching.
      Xuemeng Song, Liqiang Nie, Yinglong Wang. Synthesis Lectures on Information Concepts, Retrieval, and Services. Morgan & Claypool Publishers. 2019. Link
    67. Multimodal Learning toward Micro-Video Understanding.
      Liqiang Nie, Meng Liu, Xuemeng Song. Synthesis Lectures on Image, Video, and Multimedia Processing. Morgan & Claypool Publishers. 2019. Link
    68. An End-to-End Attention-Based Neural Model for Complementary Clothing Matching.
      Jinhuan Liu, Xuemeng Song, Liqiang Nie, Tian Gan, Jun Ma. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 2019. Pdf
    69. Neural Compatibility Modeling with Probabilistic Knowledge Distillation.
      Xianjing Han, Xuemeng Song, Yiyang Yao, Xin-Shun Xu, Liqiang Nie. IEEE Transactions on Image Processing (TIP), 2019. Pdf
    70. GP-BPR: Personalized Compatibility Modeling for Clothing Matching.
      Xuemeng Song, Xianjing Han, Yunkai Li, Jingyuan Chen, Xin-Shun Xu, Liqiang Nie. In MM, 2019. (Full Paper) Pdf  Code
      Dataset: We have released the dataset IQON3000 and features Features to facilitate the research community.
    71. Personalized Capsule Wardrobe Creation with Garment and User Modeling.
      Xue Dong, Xuemeng Song, Fuli Feng, Peiguang Jing, Xin-Shun Xu, Liqiang Nie. In MM, 2019. (Full Paper) Pdf  Code
    72. Virtually Trying on New Clothing with Arbitrary Poses.
      Na Zheng, Xuemeng Song, Zhaozheng Chen, Linmei Hu, Da Cao, Liqiang Nie. In MM, 2019. (Full Paper) Pdf  Code
    73. Seeking Micro-influencers for Brand Promotion.
      Tian Gan, Shaokun Wang, Meng Liu, Xuemeng Song, Yiyang Yao, Liqiang Nie. In MM, 2019. (Full Paper)
    74. Efficient Discrete Latent Semantic Hashing for Scalable Cross-modal Retrieval.
      Xu Lu, Lei Zhu, Zhiyong Cheng, Xuemeng Song, Huaxiang Zhang. Signal Processing, 2019.
    75. Neural Fashion Experts: I Know How to Make the Complementary Clothing Matching.
      Jinhuan Liu, Xuemeng Song, Zhumin Chen, Jun Ma. Neurocomputing, 2019. Pdf
    76. Prototype-guided Attribute-wise Interpretable Scheme for Clothing Matching.
      Xianjing Han, Xuemeng Song, Jianhua Yin, Yinglong Wang, Liqiang Nie. In SIGIR, 2019. (Full paper) Pdf  Code
    77. Supervised Hierarchical Cross-Modal Hashing.
      Changchang Sun, Xuemeng Song, Fuli Feng, Wayne Xin Zhao, Hao Zhang, Liqiang Nie. In SIGIR, 2019. (Full paper) Pdf
    78. User Attention-guided Multimodal Dialog Systems.
      Chen Cui, Wenjie Wang, Xuemeng Song, Minlie Huang, Xin-Shun Xu, Liqiang Nie. In SIGIR, 2019. (Full paper) Pdf
    79. Neural Compatibility Modeling with Attentive Knowledge Distillation.
      Xuemeng Song, Fuli Feng, Xianjing Han, Xin Yang, Liqiang Nie, Wei Liu. In SIGIR, 2018. (Full paper) Pdf  Code
    80. A Personal Privacy Preserving Framework: I Let You Know Who Can See What.
      Xuemeng Song, Xiang Wang, Liqiang Nie, Xiangnan He, Zhumin Chen, Wei Liu. In SIGIR, 2018. (Full paper) Pdf
    81. Adaptive Collaborative Similarity Learning for Unsupervised Multi-view Feature Selection.
      Xiao Dong, Lei Zhu, Xuemeng Song, Jingjing Li, Zhiyong Cheng. In IJCAI, 2018. (Full paper) Pdf
    82. SDMCH: Supervised Discrete Manifold-Embedded Cross-Modal Hashing.
      Xin Luo, Xiao-Ya Yin, Liqiang Nie, Xuemeng Song, Yongxin Wang, Xin-Shun Xu. In IJCAI, 2018. (Full paper) Pdf
    83. A^3NCF: An Adaptive Aspect Attention Model for Rating Prediction.
      Zhiyong Cheng, Ying Ding, Xiangnan He, Lei Zhu, Xuemeng Song, Mohan S. Kankanhalli. In IJCAI, 2018. (Full paper) Pdf
    84. Scalable Graph Based Non-negative Multi-view Embedding for Image Ranking.
      Shuhan Qi, Xuan Wang, Xi Zhang, Xuemeng Song, Zoe L. Jiang. Neurocomputing, 274: 29-36, 2018. Pdf
    85. Venue Prediction for Social Images by Exploiting Rich Temporal Patterns in LBSNs.
      Jingyuan Chen, Xiangnan He, Xuemeng Song, Hanwang Zhang, Liqiang Nie, Tat-Seng Chua. In MMM, 2018. (Full paper) Pdf
    86. Video Logo Removal Detection Based on Sparse Representation.
      Xiao Jin, Yuting Su, Liang Zou, Chengqian Zhang, Peiguang Jing, Xuemeng Song. Multimedia Tools and Applications, 2018.
    87. NeuroStylist: Neural Compatibility Modeling for Clothing Matching.
      Xuemeng Song, Fuli Feng, Jinhuan Liu, Zekun Li, Liqiang Nie, Jun Ma. In MM, 2017. (Full paper) Pdf  Code
      Dataset: We have released the dataset FashionVC to facilitate the research community.
    88. Unifying virtual and physical worlds: Learning toward local and global consistency.
      Xiang Wang, Liqiang Nie, Xuemeng Song, Dongxiang Zhang, Tat-Seng Chua. ACM Transactions on Information Systems (TOIS), 2017. Pdf
    89. Modeling Disease Progression via Multisource Multitask Learners: A Case Study With Alzheimer's Disease.
      Liqiang Nie, Luming Zhang, Lei Meng, Xuemeng Song, Xiaojun Chang, Xuelong Li. IEEE Transactions on Neural Network Learning System (TNNLS), 2017. Pdf
    90. Micro Tells Macro: Predicting the Popularity of Micro-Videos via a Transductive Model.
      Jingyuan Chen, Xuemeng Song, Liqiang Nie, Xiang Wang, Hanwang Zhang, Tat-Seng Chua. In MM, 2016. (Full paper) Pdf
    91. Learning from Multiple Social Networks.
      Liqiang Nie, Xuemeng Song, Tat-Seng Chua. Synthesis Lectures on Information Concepts, Retrieval, and Services. Morgan & Claypool Publishers, 2016. Link
    92. Volunteerism Tendency Prediction via Harvesting Multiple Social Networks.
      Xuemeng Song, Zhao-Yan Ming, Liqiang Nie, Yi-Liang Zhao, Tat-Seng Chua. ACM Transactions on Information Systems (TOIS), 2016. Pdf
    93. Fusing Social Networks with Deep Learning for Volunteerism Tendency Prediction.
      Yongpo Jia, Xuemeng Song, Jingbo Zhou, Li Liu, Liqiang Nie, David S. Rosenblum. In AAAI, 2016. (Full paper) Pdf
    94. Interest Inference via Structure-Constrained Multi-Source Multi-Task Learning.
      Xuemeng Song, Liqiang Nie, Luming Zhang, Maofu Liu, Tat-Seng Chua. In IJCAI, 2015. (Full paper) Pdf
    95. Multiple Social Network Learning and Its Application in Volunteerism Tendency Prediction.
      Xuemeng Song, Liqiang Nie, Luming Zhang, Mohammad Akbari, Tat-Seng Chua. In SIGIR, 2015. (Full paper) Pdf
    96. Enrichment of User Profiles Across Multiple Online Social Networks for Volunteerism Matching for Social Enterprise. Xuemeng Song. In SIGIR, 2014. Pdf
    Research

    Fashion Analysis towards Clothing Matching

    According to the Goldman Sachs, the 2016 online retail market of China for fashion products, including apparel, footwear, and accessories, has reached 187.5 billion US dollars, which demonstrates people’s great demand for clothing. In fact, apart from physiological needs, people also have esteem needs of clothes as dressing properly is of importance in daily life. As each outfit usually involves multiple complementary items (e.g., tops, bottoms, and shoes), the key to a proper outfit lies in the harmonious clothing matching to a great extent. However, not everyone is a naturalborn fashion stylist, which makes choosing the matching clothes a tedious and even annoying daily routine. It thus deserves our attention to develop an effective clothing matching scheme to help people figure out the suitable match for a given item and make a harmonious outfit.

    Composing Text and Image for Image Retrieval

    Image retrieval refers to retrieving images that meet the user’s search intent. Traditional image retrieval systems only allow users to use either the text or image query to express their search intent. However, in many cases, it is intractable for users to describe their search intent via a single textual query, meanwhile it is also difficult for users to find the ideal images to exactly convey their intent. Consequently, to allow users to flexibly express their search intent, composing text and image for image retrieval (CTI-IR) is recently proposed and gaining increasing research attention.

    User Profiling across Multiple Social Networks

    User profiling, which aims to infer users' unobservable information based on observable information such as individual's behavior or utterances, is the basis for many applications, such as personalized recommendation, and expert finding. Traditional user profiling conducted with traditional medium, such as document records, is always hindered by the limited data sources. Recent years, the proliferation of social media has opened new opportunities for user profiling. Moreover, as different social networks provide different services, increasing number of people are involved in multiple social networks. Different aspects can be revealed by different social networks. Therefore, to comprehensively learn users' profiles, it is time to shift from a single social network to multiple social networks.