Welcome to Huanhuan Ma (Andy)’s Personal Homepage!

I am a master student at the Institute of Automation, Chinese Academy of Sciences (expected to graduate in June 2024). Additionally, I am a member at the Center for Research on Intelligent Perception and Computing (CRIPAC), National Laboratory of Pattern Recognition (NLPR). I am fortunate to be advised by Qiang Liu and Liang Wang.

My research interests lie in the field of natural language processing (NLP), with a focus on fake information detection, including fact verification and out-of-context detection. Currently, I am highly intrigued by exploring the intersection of Large Language Models (LLMs) and AI safety.

I have spent wonderful time at BAAI, and NC State as a research intern/assistant.

"With a Ph.D. you will have a better chance of spending the rest of your life doing what you want to do, instead of what someone else wants you to do."
— William Lipscomb

🔥 News

  • 2024.07:  🎉🎉 A CIKM short paper has been accepted. Congratulations to YiFan Wei🎉.
  • 2024.05:  📢 Our paper “EX-FEVER: A Dataset for Multi-hop Explainable Fact Verification” has been accepted to ACL 2024 Findings!
  • 2023.12:  🎉 Our paper “Interpretable Multimodal Out-of-Context Detection with Soft Logic Regularization” has been accepted as an oral presentation at ICASSP 2024!
  • 2023.10:  🎉 Our paper “MenatQA: A New Dataset for Testing the Temporal Comprehension and Reasoning Abilities of Large Language Models” has been accepted to EMNLP 2023 Findings!

📝 Publications

ACL 2024 Findings
sym

EX-FEVER: A Dataset for Multi-hop Explainable Fact Verification

Huanhuan Ma, Weizhi Xu, Yifan Wei, Liuji Chen, Liang Wang, Qiang Liu, Shu Wu, Liang Wang

Findings of the Association for Computational Linguistics ACL 2024

We introduce a large scale Multi-hop fact checking dataset with textual explanations, which can be used to evaluate the explainability of fact verification models.

[PDF] [Code] [Poster] [Slide]

ICASSP 2024 Oral
sym

Interpretable Multimodal Out-of-Context Detection with Soft Logic Regularization

Huanhuan Ma*, Jinghao Zhang*, Qiang Liu, Shu Wu, Liang Wang

IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2024

We introduce a novel multimodal out-of-context detection framework with soft logic regularization, which can effectively detect out-of-context information with interpretability.

[PDF] [Slide]

CIKM 2024
sym

Does Knowledge Localization Hold True? Surprising Differences Between Entity and Relation Perspectives in Language Models

Yifan Wei, Xiaoyan Yu, Yixuan Weng, Huanhuan Ma, Yuanzhe Zhang, Jun Zhao, Kang Liu

Proceedings of the 33rd ACM International Conference on Information and Knowledge Management: CIKM 2024:

This study investigates the differences between entity and relational knowledge through knowledge editing. Our findings reveal that entity and relational knowledge cannot be directly transferred or mapped to each other.

[PDF] [Code]

EMNLP 2023 Findings
sym

MenatQA: A New Dataset for Testing the Temporal Comprehension and Reasoning Abilities of Large Language Models

Yifan Wei, Yisong Su, Huanhuan Ma, Xiaoyan Yu, Fangyu Lei, Yuanzhe Zhang, Jun Zhao, Kang Liu

Findings of the Association for Computational Linguistics: EMNLP 2023

We construct Multiple Sensitive Factors Time QA (MenatQA), which encompasses three temporal factors (scope factor, order factor, counterfactual factor) with total 2,853 samples for evaluating the time comprehension and reasoning abilities of LLMs.

[PDF] [Code]

ArXiv
sym

Assessing knowledge editing in language models via relation perspective

Yifan Wei, Xiaoyan Yu, Huanhuan Ma, Fangyu Lei, Yixuan Weng, Ran Song, Kang Liu

[PDF] [ArXiv] [Code]

DMBD 2022
sym

Multi-Cause Learning for Diagnosis Prediction

Liping Wang, Qiang Liu, Huanhuan Ma, Shu Wu, Liang Wang

Data Mining and Big Data (DMBD) 2022

[PDF]

🚀 Projects

📖 Educations

  • 2021.09 - 2024.07, M.S. in Artificial Intelligence, Institute of Automation, Chinese Academy of Sciences. Advisors: Prof. Liang Wang and Prof. Qiang Liu.

  • 2016.09 - 2020.07, B.E. in Software Engineering, Zhengzhou University.

💻 Internships

📅 Academic Services

📖 Reviewers

  • The International Conference on Learning Representations (ICLR) 2025, Reviewer
  • ACM International Conference on Information and Knowledge Management (CIKM) 2024, PC member
  • Annual Conference on Neural Information Processing Systems (NeurIPS) Dataset&Benchmark track 2023, Reviewer