What is wrong with your code generated by large language models? An extensive study.

Mingxu Chai

Shihan Dou Haoxiang Jia Shenxi Wu Huiyuan Zheng Muling Wu Yunbo Tao Ming Zhang 0030 Mingxu Chai Jessica Fan Zhiheng Xi Rui Zheng Yueming Wu 0001 Ming Wen Tao Gui Qi Zhang 0001 Xipeng Qiu Xuanjing Huang 0001 What is wrong with your code generated by large language models? An extensive study. 2026 69 Sci. China Inf. Sci. 1 https://doi.org/10.1007/s11432-025-4632-8 db/journals/chinaf/chinaf69.html#DouJWZWTZCFXZWWGZQH26 streams/journals/chinaf

Chong Zhang Yixi Zhao Yulu Xie Chenshu Yuan Yi Tu Ya Guo Mingxu Chai Ziyu Shen Yue Zhang Qi Zhang 0001 Unveiling the Deficiencies of Pre-trained Text-and-Layout Models in Real-world Visually-rich Document Information Extraction. EACL (Findings) 2026 1-16 conf/eacl/2026f https://aclanthology.org/2026.findings-eacl.1/ db/conf/eacl/eacl2026f.html#ZhangZXYTGCSZZ26 streams/conf/eacl

Dingwei Zhu Zhiheng Xi Shihan Dou Jiahan Li Chenhao Huang Junjie Ye 0005 Sixian Li Mingxu Chai Yuhui Wang Yajie Yang Ming Zhang 0030 Jiazheng Zhang Shichun Liu Caishuang Huang Yunke Zhang Yuran Wang Tao Gui Xipeng Qiu Qi Zhang 0001 Xuanjing Huang 0001 DFPO: Scaling Value Modeling via Distributional Flow towards Robust and Generalizable LLM Post-Training. 2026 February abs/2602.05890 CoRR https://doi.org/10.48550/arXiv.2602.05890 db/journals/corr/corr2602.html#abs-2602-05890 streams/journals/corr

Mingxu Chai Ziyu Shen Chong Zhang Yue Zhang 0073 Xiao Wang 0001 Shihan Dou Jihua Kang Jiazheng Zhang Qi Zhang 0001 DocFusion: A Unified Framework for Document Parsing Tasks. 7584-7599 2025 ACL (Findings) https://aclanthology.org/2025.findings-acl.393/ conf/acl/2025f db/conf/acl/acl2025f.html#ChaiSZZWDKZZ25 Ming Zhang 0030 Yujiong Shen Zelin Li Huayu Sha Binze Hu Yuhui Wang Chenhao Huang Shichun Liu Jingqi Tong Changhao Jiang Mingxu Chai Zhiheng Xi Shihan Dou Tao Gui Qi Zhang 0001 Xuanjing Huang 0001 LLMEval-Med: A Real-world Clinical Benchmark for Medical LLMs with Physician Validation. EMNLP (Findings) 2025 4888-4914 conf/emnlp/2025f https://aclanthology.org/2025.findings-emnlp.263/ db/conf/emnlp/emnlp2025f.html#ZhangSLSHWHLTJCXDGZH25 streams/conf/emnlp Chenhao Huang Ziyu Shen Yicong Ren Huiyuan Zheng Jiazheng Zhang Mingxu Chai Ming Zhang 0030 Shihan Dou Fan Mo Jie Shi Tao Gui Qi Zhang 0001 Xuanjing Huang 0001 Governance in Motion: Co-evolution of Constitutions and AI models for Scalable Safety. 17187-17210 2025 EMNLP https://doi.org/10.18653/v1/2025.emnlp-main.869 conf/emnlp/2025 db/conf/emnlp/emnlp2025.html#HuangSRZZCZDMSGZH25 streams/conf/emnlp

Jiazheng Zhang Wenqing Jing Zizhuo Zhang Zhiheng Xi Shihan Dou Rongxiang Weng Jiahuan Li Jingang Wang Mingxu Chai Shibo Hong Tao Gui Qi Zhang 0001 Two Minds Better Than One: Collaborative Reward Modeling for LLM Alignment. 2025 May abs/2505.10597 CoRR https://doi.org/10.48550/arXiv.2505.10597 db/journals/corr/corr2505.html#abs-2505-10597 streams/journals/corr

Ming Zhang 0030 Yujiong Shen Zelin Li Huayu Sha Binze Hu Yuhui Wang Chenhao Huang Shichun Liu Jingqi Tong Changhao Jiang Mingxu Chai Zhiheng Xi Shihan Dou Tao Gui Qi Zhang 0001 Xuanjing Huang 0001 LLMEval-Med: A Real-world Clinical Benchmark for Medical LLMs with Physician Validation. 2025 June abs/2506.04078 CoRR https://doi.org/10.48550/arXiv.2506.04078 db/journals/corr/corr2506.html#abs-2506-04078 streams/journals/corr

Dingwei Zhu Shihan Dou Zhiheng Xi Senjie Jin Guoqiang Zhang Jiazheng Zhang Junjie Ye 0005 Mingxu Chai Enyu Zhou Ming Zhang 0030 Caishuang Huang Yunke Zhang Yuran Wang Tao Gui VRPO: Rethinking Value Modeling for Robust RL Training under Noisy Supervision. 2025 August abs/2508.03058 CoRR https://doi.org/10.48550/arXiv.2508.03058 db/journals/corr/corr2508.html#abs-2508-03058 streams/journals/corr

Liujian Tang Shaokang Dong Yijia Huang Minqi Xiang Hongtao Ruan Bin Wang Shuo Li Zhiheng Xi Zhihui Cao Hailiang Pang Heng Kong He Yang Mingxu Chai Zhilin Gao Xingyu Liu Yingnan Fu Jiaming Liu Xuanjing Huang 0001 Yu-Gang Jiang 0001 Tao Gui Qi Zhang 0001 Kang Wang Yunke Zhang Yuran Wang MagicGUI: A Foundational Mobile GUI Agent with Scalable Data Pipeline and Reinforcement Fine-tuning. 2025 August abs/2508.03700 CoRR https://doi.org/10.48550/arXiv.2508.03700 db/journals/corr/corr2508.html#abs-2508-03700 streams/journals/corr

Ming Zhang 0030 Yujiong Shen Jingyi Deng Yuhui Wang Yue Zhang 0004 Junzhe Wang 0001 Shichun Liu Shihan Dou Huayu Sha Qiyuan Peng Changhao Jiang Jingqi Tong Yilong Wu Zhihao Zhang 0002 Mingqi Wu Zhiheng Xi Mingxu Chai Tao Liang Zhihui Fei Zhen Wang 0020 Mingyang Wan Guojun Ma Tao Gui Qi Zhang 0001 Xuanjing Huang 0001 LLMEval-3: A Large-Scale Longitudinal Study on Robust and Fair Evaluation of Large Language Models. 2025 August abs/2508.05452 CoRR https://doi.org/10.48550/arXiv.2508.05452 db/journals/corr/corr2508.html#abs-2508-05452 streams/journals/corr

Li Ju Jun Zhao 0019 Mingxu Chai Ziyu Shen Xiangyang Wang Yage Geng Chunchun Ma Hao Peng Guangbin Li Tao Li Chengyong Liao Fu Wang Xiaolong Wang Junshen Chen Rui Gong Shijia Liang Feiyan Li Ming Zhang 0030 Kexin Tan Jujie Ye Zhiheng Xi Shihan Dou Tao Gui Yuankai Ying Yang Shi Yue Zhang Qi Zhang 0001 WisPaper: Your AI Scholar Search Engine. 2025 December abs/2512.06879 CoRR https://doi.org/10.48550/arXiv.2512.06879 db/journals/corr/corr2512.html#abs-2512-06879 streams/journals/corr

Chong Zhang Yi Tu Yixi Zhao Chenshu Yuan Huan Chen 0012 Yue Zhang 0073 Mingxu Chai Ya Guo Huijia Zhu Qi Zhang 0001 Tao Gui Modeling Layout Reading Order as Ordering Relations for Visually-rich Document Understanding. 9658-9678 2024 EMNLP https://doi.org/10.18653/v1/2024.emnlp-main.540 https://aclanthology.org/2024.emnlp-main.540 conf/emnlp/2024 db/conf/emnlp/emnlp2024.html#ZhangTZYCZCGZZG24

Weikang Zhou Xiao Wang 0001 Limao Xiong Han Xia 0001 Yingshuang Gu Mingxu Chai Fukang Zhu Caishuang Huang Shihan Dou Zhiheng Xi Rui Zheng Songyang Gao Yicheng Zou Hang Yan 0001 Yifan Le Ruohui Wang Lijun Li Jing Shao Tao Gui Qi Zhang 0001 Xuanjing Huang 0001 EasyJailbreak: A Unified Framework for Jailbreaking Large Language Models. 2024 abs/2403.12171 CoRR https://doi.org/10.48550/arXiv.2403.12171 db/journals/corr/corr2403.html#abs-2403-12171

Shihan Dou Haoxiang Jia Shenxi Wu Huiyuan Zheng Weikang Zhou Muling Wu Mingxu Chai Jessica Fan Caishuang Huang Yunbo Tao Yan Liu 0002 Enyu Zhou Ming Zhang 0030 Yuhao Zhou 0005 Yueming Wu 0001 Rui Zheng Ming Wen Rongxiang Weng Jingang Wang Xunliang Cai Tao Gui Xipeng Qiu Qi Zhang 0001 Xuanjing Huang 0001 What's Wrong with Your Code Generated by Large Language Models? An Extensive Study. 2024 abs/2407.06153 CoRR https://doi.org/10.48550/arXiv.2407.06153 db/journals/corr/corr2407.html#abs-2407-06153 streams/journals/corr

Chong Zhang Yi Tu Yixi Zhao Chenshu Yuan Huan Chen 0012 Yue Zhang 0073 Mingxu Chai Ya Guo Huijia Zhu Qi Zhang 0001 Tao Gui Modeling Layout Reading Order as Ordering Relations for Visually-rich Document Understanding. 2024 abs/2409.19672 CoRR https://doi.org/10.48550/arXiv.2409.19672 db/journals/corr/corr2409.html#abs-2409-19672 streams/journals/corr

Mingxu Chai Ziyu Shen Chong Zhang Yue Zhang 0073 Xiao Wang 0001 Shihan Dou Jihua Kang Jiazheng Zhang Qi Zhang 0001 DocFusion: A Unified Framework for Document Parsing Tasks. 2024 abs/2412.12505 CoRR https://doi.org/10.48550/arXiv.2412.12505 db/journals/corr/corr2412.html#abs-2412-12505 streams/journals/corr

Xunliang Cai Zhihui Cao Huan Chen 0012 Junshen Chen Jingyi Deng Shaokang Dong Shihan Dou Jessica Fan Zhihui Fei Yingnan Fu Songyang Gao Zhilin Gao Yage Geng Rui Gong Yingshuang Gu Tao Gui Ya Guo Shibo Hong Binze Hu Caishuang Huang Chenhao Huang Xuanjing Huang 0001 Yijia Huang Haoxiang Jia Changhao Jiang Yu-Gang Jiang 0001 Senjie Jin Wenqing Jing Li Ju Jihua Kang Heng Kong Yifan Le Feiyan Li Guangbin Li Jiahan Li Jiahuan Li Lijun Li Shuo Li Sixian Li Tao Li Zelin Li Shijia Liang Tao Liang Chengyong Liao Jiaming Liu Shichun Liu Xingyu Liu Yan Liu 0002 Chunchun Ma Guojun Ma Fan Mo Hailiang Pang Hao Peng Qiyuan Peng Xipeng Qiu Yicong Ren Hongtao Ruan Huayu Sha Jing Shao Yujiong Shen Ziyu Shen Jie Shi Yang Shi Kexin Tan Liujian Tang Yunbo Tao Jingqi Tong Yi Tu Mingyang Wan Bin Wang Fu Wang Jingang Wang Junzhe Wang 0001 Kang Wang Ruohui Wang Xiangyang Wang Xiao Wang 0001 Xiaolong Wang Yuhui Wang Yuran Wang Zhen Wang 0020 Ming Wen Rongxiang Weng Mingqi Wu Muling Wu Shenxi Wu Yilong Wu Yueming Wu 0001 Zhiheng Xi Han Xia 0001 Minqi Xiang Yulu Xie Limao Xiong Hang Yan 0001 He Yang Yajie Yang Jujie Ye Junjie Ye 0005 Yuankai Ying Chenshu Yuan Chong Zhang Guoqiang Zhang Jiazheng Zhang Ming Zhang 0030 Qi Zhang 0001 Yue Zhang Yue Zhang 0004 Yue Zhang 0073 Yunke Zhang Zhihao Zhang 0002 Zizhuo Zhang Jun Zhao 0019 Yixi Zhao Huiyuan Zheng Rui Zheng Enyu Zhou Weikang Zhou Yuhao Zhou 0005 Dingwei Zhu Fukang Zhu Huijia Zhu Yicheng Zou