I am Jiaju Chen, a Ph.D. student in Computer Science at Northeastern University, advised by Prof. Dakuo Wang at the Human-Centered AI Lab. Previously, I earned my master’s degree in Computer Science from Rice University and my bachelor’s degree in Computer Science from East China Normal University.

My research explores how people and LLM agents can work together, and what it takes to build and evaluate the systems that make such collaboration possible. I currently investigate three directions:

• Human-Agent Collaboration: how humans and LLM agents establish common ground and coordinate on shared tasks, through a configurable research platform [CHI ‘26] and a dataset of action-level human mental model annotations [EMNLP ‘26].
• Multi-Agent Evaluation & Simulation: methods to assess and simulate the collaborative competence of LLM agents, including a Multi-Agent-as-Judge evaluation framework [ACL ‘26] and CollabSim, a CSCW-grounded simulation methodology [Preprint].
• LLM Knowledge Augmentation & Domain Adaptation: adapting LLMs to support children’s personalized, story-based learning, from expert-annotated knowledge grounding [EMNLP ‘24] to personalized story-reading systems [CHI ‘25], informed by need-finding studies with parents and teachers [CSCW ‘24] [CHI ‘25].

News

Publications

2026

EMNLP 2026 Findings

Humans' ALMANAC: A Human Collaboration Dataset of Action-Level Mental Model Annotations for Agent Collaboration

Jiaju Chen, Yuxuan Lu, Jiayi Su, Chaoran Chen, Songlin Xiao, Zheng Zhang, Yun Wang, Yunyao Li, Jian Zhao, Tongshuang Wu, Toby Jia-Jun Li, Dakuo Wang, Bingsheng Yao.

Preprint

Arxiv Project Website Dataset

Preprint

CollabSim: A CSCW-Grounded Methodology for Investigating Collaborative Competence of LLM Agents through Controlled Multi-Agent Experiments

Jiaju Chen, Bo Sun, Yuxuan Lu, Yun Wang, Dakuo Wang, Bingsheng Yao.

Preprint

Arxiv Project Website Code

ACL 2026

Multi-Agent-as-Judge: Aligning LLM-Agent-Based Automated Evaluation with Multi-Dimensional Human Evaluation

Jiaju Chen, Yuxuan Lu, Xiaojie Wang, Huimin Zeng, Jing Huang, Jiri Gesi, Ying Xu, Bingsheng Yao, Dakuo Wang.

In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics.

Arxiv Code

CHI 2026

Through the Lens of Human-Human Collaboration: A Configurable Research Platform for Exploring Human-Agent Collaboration

Bingsheng Yao*, Jiaju Chen*, Chaoran Chen, April Wang, Toby Jia-jun Li, Dakuo Wang.

In Proceedings of the CHI Conference on Human Factors in Computing Systems, 2026

Arxiv

2025

CHI 2025

Characterizing LLM-Empowered Personalized Story-Reading and Interaction for Children: Insights from Multi-Stakeholder Perspectives

Jiaju Chen, Minglong Tang Yuxuan Lu, Bingsheng Yao, Elissa Fan, Xiaojuan Ma, Ying Xu, Dakuo Wang, Yuling Sun, Liang He.

In Proceedings of the CHI Conference on Human Factors in Computing Systems, 2025

Arxiv Presentation Demo Code

CHI 2025

Live-Streaming-Based Dual-Teacher Classes for Equitable Education: Insights and Challenges From Local Teachers' Perspective in Disadvantaged Areas

Yuling Sun, Jiaju Chen, Xiaomu Zhou, Xiaojuan Ma, Bingsheng Yao, Kai Zhang, Liang He, Dakuo Wang.

In Proceedings of the CHI Conference on Human Factors in Computing Systems, 2025

Paper

2024

EMNLP 2024

StorySparkQA: Expert-Annotated QA Pairs with Real-World Knowledge for Children's Story-Based Learning

Jiaju Chen, Yuxuan Lu, Shao Zhang, Bingsheng Yao, Yuanzhe Dong, Ying Xu, Yunyao Li, Qianwen Wang, Dakuo Wang, Yuling Sun, Liang He.

In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing

Arxiv Code Dataset

CSCW 2024

Exploring Parent's Needs for Children-Centered AI to Support Preschoolers' Interactive Storytelling and Reading Activities

Yuling Sun, Jiaju Chen, Bingsheng Yao, Jiali Liu, Dakuo Wang, Xiaojuan Ma, Yuxuan Lu, Ying Xu, Liang He.

In Proceedings of the ACM on Human-Computer Interaction, Volume 8, Issue CSCW2

Arxiv