Toby Jia-Jun Li
Publication record assembled from the DBLP archive of ranked conferences.
Papers indexed
70
Venues
11
Active years
2016–2026
Best venue rank
A*
Where they publish
Papers
70 indexed papers, newest first.
| Year | Venue | Title | Authors |
|---|---|---|---|
| 2026 | ACL | LLMs for Now, Fine-Tuning for Later: An Ensemble Approach to Data Drift in Domain-Specific Tasks. | Yuxuan Lu, Bingsheng Yao, Shao Zhang, Yisi Sang, Yun Wang, Hansu Gu, Peng Zhang, Tun Lu, Toby Jia-Jun Li, Dakuo Wang |
| 2026 | ACL | OPeRA: A Dataset of Observation, Persona, Rationale, and Action for Evaluating LLMs on Human Online Shopping Behavior Simulation. | Ziyi Wang, Yuxuan Lu, Wenbo Li, Amirali Amini, Bo Sun, Yakov Bart, Weimin Lyu, Jiri Gesi, Tian Wang, Jing Huang, Yu Su, Upol Ehsan, Malihe Alikhani, Toby Jia-Jun Li, Lydia B. Chilton, Dakuo Wang |
| 2026 | ACL | EyeMulator: Improving Code Language Models by Mimicking Human Visual Attention. | Yifan Zhang, Chen Huang, Yueke Zhang, Jiahao Zhang, Toby Jia-Jun Li, Collin McMillan, Kevin Leach, Yu Huang |
| 2026 | CHI | Vistoria: A Multimodal System to Support Fictional Story Writing through Instrumental Image-Text Co-Editing. | Kexue Fu, Jingfei Huang, Long Ling, Sumin Hong, Yihang Zuo, Ray LC, Toby Jia-Jun Li |
| 2026 | CHI | Crepe: A Mobile Screen Data Collector Using Graph Query. | Yuwen Lu, Meng Chen, Qi Zhao, Victor V. Cox, Yang Yang, Meng Jiang, Jay Brockman, Tamara Kay, Toby Jia-Jun Li |
| 2026 | CHI | Designing Staged Evaluation Workflows for LLMs: Integrating Domain Experts, Lay Users, and Model-Generated Evaluation Criteria. | Annalisa Szymanski, Simret Araya Gebreegziabher, Oghenemaro Anuyah, Ronald A. Metoyer, Toby Jia-Jun Li |
| 2026 | CHI | Dark Patterns Meet GUI Agents: LLM Agent Susceptibility to Manipulative Interfaces and the Role of Human Oversight. | Jingyu Tang, Chaoran Chen, Jiawen Li, Zhiping Zhang, Bingcan Guo, Ibrahim Khalilov, Simret Araya Gebreegziabher, Bingsheng Yao, Dakuo Wang, Yanfang Ye, Tianshi Li, Ziang Xiao, Yaxing Yao, Toby Jia-Jun Li |
| 2026 | CHI | Through the Lens of Human-Human Collaboration: An Configurable Research Platform for Exploring Human-Agent Collaboration. | Bingsheng Yao, Jiaju Chen, Chaoran Chen, April Yi Wang, Toby Jia-Jun Li, Dakuo Wang |
| 2026 | CHI | From Human-Human Collaboration to Human-Agent Collaboration: A Vision, Design Philosophy, and an Empirical Framework for Achieving Successful Partnerships Between Humans and LLM Agents. | Bingsheng Yao, Chaoran Chen, April Yi Wang, Tongshuang Wu, Toby Jia-Jun Li, Dakuo Wang |
| 2026 | CHI | My Favorite Streamer is an LLM: Discovering, Bonding, and Co-Creating in AI VTuber Fandom. | Jiayi Ye, Chaoran Chen, Yue Huang, Yanfang Ye, Toby Jia-Jun Li, Xiangliang Zhang |
| 2026 | IUI | EvalAgent: Interactive Comparative Evaluation of Computer-Using GUI Agents. | Yukun Yang, Simret Araya Gebreegziabher, Hojun Yoo, Charles Chiang, Chaoran Chen, Annalisa Szymanski, Hyo Jin Do, Zahra Ashktorab, Werner Geyer, Diego Gmez-Zar, Toby Jia-Jun Li |
| 2026 | IUI | MultEval: Collaboratively Creating Criteria for LLM-as-a-Judge Systems. | Charles Chiang, Simret Araya Gebreegziabher, Annalisa Szymanski, Yukun Yang, Hyo Jin Do, Zahra Ashktorab, Werner Geyer, Toby Jia-Jun Li, Diego Gmez-Zar |
| 2026 | IUI | The Behavioral Fabric of LLM-Powered GUI Agents: Human Values and Interaction Outcomes. | Simret Araya Gebreegziabher, Yukun Yang, Charles Chiang, Hojun Yoo, Chaoran Chen, Hyo Jin Do, Zahra Ashktorab, Werner Geyer, Diego Gmez-Zar, Toby Jia-Jun Li |
| 2026 | IUI | TRUST-CUA: Trustworthy Computer-Using Generalist Agents for Intelligent User Interfaces (Workshop). | Toby Jia-Jun Li, Segev Shlomov, Xiang Deng, Ronen I. Brafman, Avi Yaeli, Zora Zhiruo Wang |
| 2026 | IUI | From Verification Burden to Trusted Collaboration: Design Goals for LLM-Assisted Literature Reviews. | Brenda Nogueira, Werner Geyer, Andrew A. Anderson, Toby Jia-Jun Li, Dongwhi Kim, Nuno Moniz, Nitesh V. Chawla |
| 2026 | IUI | Key Considerations for Domain Expert Involvement in LLM Design and Evaluation: An Ethnographic Study. | Annalisa Szymanski, Oghenemaro Anuyah, Toby Jia-Jun Li, Ronald A. Metoyer |
| 2025 | ACL | Towards a Design Guideline for RPA Evaluation: A Survey of Large Language Model-Based Role-Playing Agents. | Chaoran Chen, Bingsheng Yao, Ruishi Zou, Wenyue Hua, Weimin Lyu, Toby Jia-Jun Li, Dakuo Wang |
| 2025 | ACL | Leveraging Variation Theory in Counterfactual Data Augmentation for Optimized Active Learning. | Simret Araya Gebreegziabher, Kuangshi Ai, Zheng Zhang, Elena L. Glassman, Toby Jia-Jun Li |
| 2025 | CCS | HAIPS '25: First ACM CCS Workshop on Human-Centered AI Privacy and Security. | Tianshi Li, Toby Jia-Jun Li, Yaxing Yao, Sauvik Das |
| 2025 | CHI | UXAgent: An LLM Agent-Based Usability Testing Framework for Web Design. | Yuxuan Lu, Bingsheng Yao, Hansu Gu, Jing Huang, Zheshen Jessie Wang, Yang Li, Jiri Gesi, Qi He, Toby Jia-Jun Li, Dakuo Wang |
| 2025 | CHI | Supporting Co-Adaptive Machine Teaching through Human Concept Learning and Cognitive Theories. | Simret Araya Gebreegziabher, Yukun Yang, Elena L. Glassman, Toby Jia-Jun Li |
| 2025 | CHI | Hashtag Re-Appropriation for Audience Control on Recommendation-Driven Social Media Xiaohongshu (rednote). | Ruyuan Wan, Lingbo Tong, Tiffany Knearem, Toby Jia-Jun Li, Ting-Hao 'Kenneth' Huang, Qunfang Wu |
| 2025 | CHI | From Operation to Cognition: Automatic Modeling Cognitive Dependencies from User Demonstrations for GUI Task Automation. | Yiwen Yin, Yu Mei, Chun Yu, Toby Jia-Jun Li, Aamir Khan Jadoon, Sixiang Cheng, Weinan Shi, Mohan Chen, Yuanchun Shi |
| 2025 | CHI | LADICA: A Large Shared Display Interface for Generative AI Cognitive Assistance in Co-located Team Collaboration. | Zheng Zhang, Weirui Peng, Xinyue Chen, Luke Cao, Toby Jia-Jun Li |
| 2025 | CSCW | CSCW Contributions to Critical Futures of Work. | Alina Lushnikova, Michael Muller, Shaowen Bardzell, Toby Jia-Jun Li, Saiph Savage |
| 2025 | IUI | CLEAR: Towards Contextual LLM-Empowered Privacy Policy Analysis and Risk Generation for Large Language Model Applications. | Chaoran Chen, Daodao Zhou, Yanfang Ye, Toby Jia-Jun Li, Yaxing Yao |
| 2025 | IUI | Unequal Opportunities: Examining the Bias in Geographical Recommendations by Large Language Models. | Shiran Dudy, Thulasi Tholeti, Resmi Ramachandranpillai, Muhammad Ali, Toby Jia-Jun Li, Ricardo Baeza-Yates |
| 2025 | IUI | MetricMate: An Interactive Tool for Generating Evaluation Criteria for LLM-as-a-Judge Workflow. | Simret Araya Gebreegziabher, Charles Chiang, Zichu Wang, Zahra Ashktorab, Michelle Brachman, Werner Geyer, Toby Jia-Jun Li, Diego Gmez-Zar |
| 2025 | IUI | Limitations of the LLM-as-a-Judge Approach for Evaluating LLM Outputs in Expert Knowledge Tasks. | Annalisa Szymanski, Noah Ziems, Heather A. Eicher-Miller, Toby Jia-Jun Li, Meng Jiang, Ronald A. Metoyer |
| 2025 | NDSS | Careful About What App Promotion Ads Recommend! Detecting and Explaining Malware Promotion via App Promotion Graph. | Shang Ma, Chaoran Chen, Shao Yang, Shifu Hou, Toby Jia-Jun Li, Xusheng Xiao, Tao Xie, Yanfang Ye |
| 2025 | UIST | Why am I seeing this: Democratizing End User Auditing for Online Content Recommendations. | Chaoran Chen, Leyang Li, Luke Cao, Yanfang Ye, Tianshi Li, Yaxing Yao, Toby Jia-Jun Li |
| 2025 | UIST | AROMA: Mixed-Initiative AI Assistance for Non-Visual Cooking by Grounding Multimodal Information Between Reality and Videos. | Zheng Ning, Leyang Li, Daniel Killough, JooYoung Seo, Patrick Carrington, Yapeng Tian, Yuhang Zhao, Franklin Mingzhe Li, Toby Jia-Jun Li |
| 2025 | UIST | GLITTER: An AI-assisted Platform for Material-Grounded Asynchronous Discussion in Flipped Learning. | Weirui Peng, Yinuo Yang, Zheng Zhang, Toby Jia-Jun Li |
| 2024 | CHI | Computational Methodologies for Understanding, Automating, and Evaluating User Interfaces. | Yue Jiang, Yuwen Lu, Tiffany Knearem, Clara E. Kliman-Silver, Christof Lutteroth, Toby Jia-Jun Li, Jeffrey Nichols, Wolfgang Stuerzlinger |
| 2024 | CHI | An Empathy-Based Sandbox Approach to Bridge the Privacy Gap among Attitudes, Goals, Knowledge, and Behaviors. | Chaoran Chen, Weijun Li, Wenxin Song, Yanfang Ye, Yaxing Yao, Toby Jia-Jun Li |
| 2024 | CHI | A Taxonomy for Human-LLM Interaction Modes: An Initial Exploration. | Jie Gao, Simret Araya Gebreegziabher, Kenny Tsu Wei Choo, Toby Jia-Jun Li, Simon Tangi Perrault, Thomas W. Malone |
| 2024 | CHI | CollabCoder: A Lower-barrier, Rigorous Workflow for Inductive Collaborative Qualitative Analysis with Large Language Models. | Jie Gao, Yuchen Guo, Gionnieve Lim, Tianqin Zhang, Zheng Zhang, Toby Jia-Jun Li, Simon Tangi Perrault |
| 2024 | CHI | SPICA: Interactive Video Content Exploration through Augmented Audio Descriptions for Blind or Low-Vision Viewers. | Zheng Ning, Brianna L. Wimer, Kaiwen Jiang, Keyi Chen, Jerrick Ban, Yapeng Tian, Yuhang Zhao, Toby Jia-Jun Li |
| 2024 | CHI | Luminate: Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creation. | Sangho Suh, Meng Chen, Bryan Min, Toby Jia-Jun Li, Haijun Xia |
| 2024 | CSCW | Challenges and Opportunities of LLM-Based Synthetic Personae and Data in HCI. | Mirjana Prpa, Giovanni Maria Troiano, Bingsheng Yao, Toby Jia-Jun Li, Dakuo Wang, Hansu Gu |
| 2024 | ICSE | CodeGRITS: A Research Toolkit for Developer Behavior and Eye Tracking in IDE. | Ningzhi Tang, Junwen An, Meng Chen, Aakash Bansal, Yu Huang, Collin McMillan, Toby Jia-Jun Li |
| 2024 | MOBICOM | AutoDroid: LLM-powered Task Automation in Android. | Hao Wen, Yuanchun Li, Guohong Liu, Shanhui Zhao, Tao Yu, Toby Jia-Jun Li, Shiqi Jiang, Yunhao Liu, Yaqin Zhang, Yunxin Liu |
| 2024 | UIST | MOCHA: Model Optimization through Collaborative Human-AI Alignment. | Simret Araya Gebreegziabher, Elena L. Glassman, Toby Jia-Jun Li |
| 2024 | UIST | SQLucid: Grounding Natural Language Database Queries with Interactive Explanations. | Yuan Tian, Jonathan K. Kummerfeld, Toby Jia-Jun Li, Tianyi Zhang |
| 2023 | CHI | The Future of Computational Approaches for Understanding and Adapting User Interfaces. | Yue Jiang, Yuwen Lu, Christof Lutteroth, Toby Jia-Jun Li, Jeffrey Nichols, Wolfgang Stuerzlinger |
| 2023 | CHI | PaTAT: Human-AI Collaborative Qualitative Coding with Explainable Interactive Rule Synthesis. | Simret Araya Gebreegziabher, Zheng Zhang, Xiaohang Tang, Yihao Meng, Elena L. Glassman, Toby Jia-Jun Li |
| 2023 | CSCW | CollabCoder: A GPT-Powered WorkFlow for Collaborative Qualitative Analysis. | Jie Gao, Yuchen Guo, Toby Jia-Jun Li, Simon Tangi Perrault |
| 2023 | CSCW | Designing for AI-Powered Social Computing Systems. | Gionnieve Lim, Hyunwoo Kim, Yoonseo Choi, Toby Jia-Jun Li, Chinmay Kulkarni, Hariharan Subramonyam, Joseph Seering, Michael S. Bernstein, Amy X. Zhang, Elena L. Glassman, Simon T. Perrault, Juho Kim |
| 2023 | CSCW | Shaping the Emerging Norms of Using Large Language Models in Social Computing Research. | Hong Shen, Tianshi Li, Toby Jia-Jun Li, Joon Sung Park, Diyi Yang |
| 2023 | EMNLP | Interactive Text-to-SQL Generation via Editable Step-by-Step Explanations. | Yuan Tian, Zheng Zhang, Zheng Ning, Toby Jia-Jun Li, Jonathan K. Kummerfeld, Tianyi Zhang |
| 2023 | IUI | SHAI 2023: Workshop on Designing for Safety in Human-AI Interactions. | Nitesh Goyal, Sungsoo Ray Hong, Regan L. Mandryk, Toby Jia-Jun Li, Kurt Luther, Dakuo Wang |
| 2023 | IUI | An Empirical Study of Model Errors and User Error Discovery and Repair Strategies in Natural Language Database Queries. | Zheng Ning, Zheng Zhang, Tianyi Sun, Yuan Tian, Tianyi Zhang, Toby Jia-Jun Li |
| 2023 | UIST | VISAR: A Human-AI Argumentative Writing Assistant with Visual Programming and Rapid Draft Prototyping. | Zheng Zhang, Jie Gao, Ranjodh Singh Dhaliwal, Toby Jia-Jun Li |
| 2023 | UIST | PEANUT: A Human-AI Collaborative Tool for Annotating Audio-Visual Data. | Zheng Zhang, Zheng Ning, Chenliang Xu, Yapeng Tian, Toby Jia-Jun Li |
| 2022 | ACL | Fantastic Questions and Where to Find Them: FairytaleQA - An Authentic Dataset for Narrative Comprehension. | Ying Xu, Dakuo Wang, Mo Yu, Daniel Ritchie, Bingsheng Yao, Tongshuang Wu, Zheng Zhang, Toby Jia-Jun Li, Nora Bradford, Branda Sun, Tran Bao Hoang, Yisi Sang, Yufang Hou, Xiaojuan Ma, Diyi Yang, Nanyun Peng, Zhou Yu, Mark Warschauer |
| 2022 | ACL | It is AI's Turn to Ask Humans a Question: Question-Answer Pair Generation for Children's Story Books. | Bingsheng Yao, Dakuo Wang, Tongshuang Wu, Zheng Zhang, Toby Jia-Jun Li, Mo Yu, Ying Xu |
| 2022 | CHI | Computational Approaches for Understanding, Generating, and Adapting User Interfaces. | Yue Jiang, Yuwen Lu, Jeffrey Nichols, Wolfgang Stuerzlinger, Chun Yu, Christof Lutteroth, Yang Li, Ranjitha Kumar, Toby Jia-Jun Li |
| 2022 | CHI | Bridging the Gap Between UX Practitioners' Work Practices and AI-Enabled Design Support Tools. | Yuwen Lu, Chengzhi Zhang, Iris Zhang, Toby Jia-Jun Li |
| 2022 | CHI | StoryBuddy: A Human-AI Collaborative Chatbot for Parent-Child Interactive Storytelling with Flexible Parental Involvement. | Zheng Zhang, Ying Xu, Yanhao Wang, Bingsheng Yao, Daniel Ritchie, Tongshuang Wu, Mo Yu, Dakuo Wang, Toby Jia-Jun Li |
| 2022 | IUI | AI as an Active Writer: Interaction Strategies with Generated Text in Human-AI Collaborative Fiction Writing 56-65. | Daijin Yang, Yanpeng Zhou, Zhiyuan Zhang, Toby Jia-Jun Li, Ray LC |
| 2021 | CHI | Screen2Vec: Semantic Embedding of GUI Screens and GUI Components. | Toby Jia-Jun Li, Lindsay Popowski, Tom M. Mitchell, Brad A. Myers |
| 2020 | ACL | Interactive Task Learning from GUI-Grounded Natural Language Instructions and Demonstrations. | Toby Jia-Jun Li, Tom M. Mitchell, Brad A. Myers |
| 2020 | UIST | Multi-Modal Interactive Task Learning from Demonstrations and Natural Language Instructions. | Toby Jia-Jun Li |
| 2020 | UIST | Multi-Modal Repairs of Conversational Breakdowns in Task-Oriented Dialogs. | Toby Jia-Jun Li, Jingya Chen, Haijun Xia, Tom M. Mitchell, Brad A. Myers |
| 2020 | UIST | Geno: A Developer Tool for Authoring Multimodal Interaction on Existing Web Applications. | Ritam Jyoti Sarmah, Yunpeng Ding, Di Wang, Cheuk Yin Phipson Lee, Toby Jia-Jun Li, Xiang 'Anthony' Chen |
| 2019 | IUI | End user programing of intelligent agents using demonstrations and natural language instructions. | Toby Jia-Jun Li |
| 2019 | UIST | PUMICE: A Multi-Modal Agent that Learns Concepts and Conditionals from Natural Language and Demonstrations. | Toby Jia-Jun Li, Marissa Radensky, Justin Jia, Kirielle Singarajah, Tom M. Mitchell, Brad A. Myers |
| 2018 | Mobisys | Kite: Building Conversational Bots from Mobile Apps. | Toby Jia-Jun Li, Oriana Riva |
| 2017 | CHI | SUGILITE: Creating Multimodal Smartphone Automation by Demonstration. | Toby Jia-Jun Li, Amos Azaria, Brad A. Myers |
| 2016 | CHI | Not at Home on the Range: Peer Production and the Urban/Rural Divide. | Isaac L. Johnson, Yilun Lin, Toby Jia-Jun Li, Andrew Hall, Aaron Halfaker, Johannes Schning, Brent J. Hecht |