How Much Would a Clinician Edit This Draft? Evaluating LLM Alignment for Patient Message Response Drafting.

Joseph Gatto

Parker Seegmiller Joseph Gatto Sarah E. Greer Ganza Belise Isingizwe Rohan Ray Timothy E. Burdick Sarah Masud Preum How Much Would a Clinician Edit This Draft? Evaluating LLM Alignment for Patient Message Response Drafting. 2026 January abs/2601.11344 CoRR https://doi.org/10.48550/arXiv.2601.11344 db/journals/corr/corr2601.html#abs-2601-11344 streams/journals/corr

Joseph Gatto Parker Seegmiller Timothy E. Burdick Philip Resnik Roshnik Rahat Sarah DeLozier Sarah M. Preum Medical Triage as Pairwise Ranking: A Benchmark for Urgency in Patient Portal Messages. 2026 January abs/2601.13178 CoRR https://doi.org/10.48550/arXiv.2601.13178 db/journals/corr/corr2601.html#abs-2601-13178 streams/journals/corr

Joseph Gatto Omar Sharif Parker Seegmiller Sarah Masud Preum Document-Level Event-Argument Data Augmentation for Challenging Role Types. 25109-25131 2025 ACL (1) https://aclanthology.org/2025.acl-long.1221/ conf/acl/2025-1 db/conf/acl/acl2025-1.html#GattoSSP25 Joseph Gatto Parker Seegmiller Timothy E. Burdick Inas S. Khayal Sarah DeLozier Sarah Masud Preum Follow-up Question Generation For Enhanced Patient-Provider Conversations. 25222-25240 2025 ACL (1) https://aclanthology.org/2025.acl-long.1226/ conf/acl/2025-1 db/conf/acl/acl2025-1.html#GattoSBKDP25 Omar Sharif Joseph Gatto Madhusudan Basak Sarah Masud Preum REGen: A Reliable Evaluation Framework for Generative Event Argument Extraction. EMNLP (Findings) 2025 12146-12168 conf/emnlp/2025f https://aclanthology.org/2025.findings-emnlp.649/ db/conf/emnlp/emnlp2025f.html#SharifGBP25 streams/conf/emnlp

Omar Sharif Joseph Gatto Madhusudan Basak Sarah M. Preum REGen: A Reliable Evaluation Framework for Generative Event Argument Extraction. 2025 February abs/2502.16838 CoRR https://doi.org/10.48550/arXiv.2502.16838 db/journals/corr/corr2502.html#abs-2502-16838 streams/journals/corr

Joseph Gatto Parker Seegmiller Timothy E. Burdick Inas S. Khayal Sarah DeLozier Sarah M. Preum Follow-up Question Generation For Enhanced Patient-Provider Conversations. 2025 March abs/2503.17509 CoRR https://doi.org/10.48550/arXiv.2503.17509 db/journals/corr/corr2503.html#abs-2503-17509 streams/journals/corr

Omar Sharif Joseph Gatto Madhusudan Basak Sarah Masud Preum Explicit, Implicit, and Scattered: Revisiting Event Extraction to Capture Complex Arguments. 12061-12081 2024 EMNLP https://doi.org/10.18653/v1/2024.emnlp-main.673 https://aclanthology.org/2024.emnlp-main.673 conf/emnlp/2024 db/conf/emnlp/emnlp2024.html#SharifGBP24 William Romano Omar Sharif Madhusudan Basak Joseph Gatto Sarah Masud Preum Theme-Driven Keyphrase Extraction to Analyze Social Media Discourse. 1315-1327 2024 ICWSM https://doi.org/10.1609/icwsm.v18i1.31391 conf/icwsm/2024 db/conf/icwsm/icwsm2024.html#RomanoSBGP24

Joseph Gatto Parker Seegmiller Omar Sharif Sarah Masud Preum Mad Libs Are All You Need: Augmenting Cross-Domain Document-Level Event Argument Data. 2024 abs/2403.03304 CoRR https://doi.org/10.48550/arXiv.2403.03304 db/journals/corr/corr2403.html#abs-2403-03304

Joseph Gatto Madhusudan Basak Yash Srivastava Philip Bohlman Sarah Masud Preum Scope of Large Language Models for Mining Emerging Opinions in Online Health Discourse. 2024 abs/2403.03336 CoRR https://doi.org/10.48550/arXiv.2403.03336 db/journals/corr/corr2403.html#abs-2403-03336

Parker Seegmiller Joseph Gatto Omar Sharif Madhusudan Basak Sarah Masud Preum Do LLMs Find Human Answers To Fact-Driven Questions Perplexing? A Case Study on Reddit. 2024 abs/2404.01147 CoRR https://doi.org/10.48550/arXiv.2404.01147 db/journals/corr/corr2404.html#abs-2404-01147

Parker Seegmiller Joseph Gatto Sarah Masud Preum Depth F<sub>1</sub>: Improving Evaluation of Cross-Domain Text Classification by Measuring Semantic Generalizability. 2024 abs/2406.14695 CoRR https://doi.org/10.48550/arXiv.2406.14695 db/journals/corr/corr2406.html#abs-2406-14695

Omar Sharif Joseph Gatto Madhusudan Basak Sarah M. Preum Explicit, Implicit, and Scattered: Revisiting Event Extraction to Capture Complex Arguments. 2024 abs/2410.03594 CoRR https://doi.org/10.48550/arXiv.2410.03594 db/journals/corr/corr2410.html#abs-2410-03594 streams/journals/corr

Joseph Gatto Parker Seegmiller Timothy E. Burdick Sarah Masud Preum In-Context Learning for Preserving Patient Privacy: A Framework for Synthesizing Realistic Patient Portal Messages. 2024 abs/2411.06549 CoRR https://doi.org/10.48550/arXiv.2411.06549 db/journals/corr/corr2411.html#abs-2411-06549 streams/journals/corr

Joseph Gatto Omar Sharif Sarah Preum Chain-of-Thought Embeddings for Stance Detection on Social Media. 4154-4161 2023 EMNLP (Findings) https://doi.org/10.18653/v1/2023.findings-emnlp.273 https://aclanthology.org/2023.findings-emnlp.273 conf/emnlp/2023f db/conf/emnlp/emnlp2023f.html#GattoSP23 Parker Seegmiller Joseph Gatto Madhusudan Basak Diane J. Cook Hassan Ghasemzadeh 0001 John A. Stankovic Sarah Preum The Scope of In-Context Learning for the Extraction of Medical Temporal Constraints. 601-609 2023 ICHI https://doi.org/10.1109/ICHI57859.2023.00107 conf/ichi/2023 db/conf/ichi/ichi2023.html#SeegmillerGBCGSP23 Joseph Gatto Madhusudan Basak Sarah Masud Preum Scope of Pre-trained Language Models for Detecting Conflicting Health Information. 221-232 2023 ICWSM https://doi.org/10.1609/icwsm.v17i1.22140 conf/icwsm/2023 db/conf/icwsm/icwsm2023.html#GattoBP23 Joseph Gatto Parker Seegmiller Garrett M. Johnston Madhusudan Basak Sarah Masud Preum HealthE: Recognizing Health Advice & Entities in Online Health Communities. 1024-1033 2023 ICWSM https://doi.org/10.1609/icwsm.v17i1.22210 conf/icwsm/2023 db/conf/icwsm/icwsm2023.html#GattoSJBP23

Parker Seegmiller Joseph Gatto Abdullah Mamun Hassan Ghasemzadeh 0001 Diane J. Cook John A. Stankovic Sarah Masud Preum ActSafe: Predicting Violations of Medical Temporal Constraints for Medication Adherence. 2023 abs/2301.07051 CoRR https://doi.org/10.48550/arXiv.2301.07051 db/journals/corr/corr2301.html#abs-2301-07051

William Romano Omar Sharif Madhusudan Basak Joseph Gatto Sarah Masud Preum Theme-driven Keyphrase Extraction from Social Media on Opioid Recovery. 2023 abs/2301.11508 CoRR https://doi.org/10.48550/arXiv.2301.11508 db/journals/corr/corr2301.html#abs-2301-11508

Parker Seegmiller Joseph Gatto Madhusudan Basak Diane J. Cook Hassan Ghasemzadeh 0001 John A. Stankovic Sarah Masud Preum The Scope of In-Context Learning for the Extraction of Medical Temporal Constraints. 2023 abs/2303.09366 CoRR https://doi.org/10.48550/arXiv.2303.09366 db/journals/corr/corr2303.html#abs-2303-09366

Joseph Gatto Omar Sharif Parker Seegmiller Philip Bohlman Sarah Masud Preum Text Encoders Lack Knowledge: Leveraging Generative LLMs for Domain-Specific Semantic Textual Similarity. 2023 abs/2309.06541 CoRR https://doi.org/10.48550/arXiv.2309.06541 db/journals/corr/corr2309.html#abs-2309-06541

Joseph Gatto Sarah Masud Preum Not Enough Labeled Data? Just Add Semantics: A Data-Efficient Method for Inferring Online Health Texts. 2023 abs/2309.09877 CoRR https://doi.org/10.48550/arXiv.2309.09877 db/journals/corr/corr2309.html#abs-2309-09877

Joseph Gatto Omar Sharif Sarah Masud Preum Chain-of-Thought Embeddings for Stance Detection on Social Media. 2023 abs/2310.19750 CoRR https://doi.org/10.48550/arXiv.2310.19750 db/journals/corr/corr2310.html#abs-2310-19750

Joseph Gatto Madhusudan Basak Sarah Masud Preum Scope of Pre-trained Language Models for Detecting Conflicting Health Information. 2022 abs/2209.11102 CoRR https://doi.org/10.48550/arXiv.2209.11102 db/journals/corr/corr2209.html#abs-2209-11102

Joseph Gatto Parker Seegmiller Garrett Johnston Sarah Masud Preum HealthE: Classifying Entities in Online Textual Health Advice. 2022 abs/2210.03246 CoRR https://doi.org/10.48550/arXiv.2210.03246 db/journals/corr/corr2210.html#abs-2210-03246

Yumi Iwashita Kazuto Nakashima Joseph Gatto Shoya Higa Adrian Stoica Norris Khoo Ryo Kurazume Virtual IR Sensing for Planetary Rovers: Improved Terrain Classification and Thermal Inertia Estimation. 6302-6309 2020 5 IEEE Robotics Autom. Lett. 4 https://doi.org/10.1109/LRA.2020.3013909 db/journals/ral/ral5.html#IwashitaNGHSKK20

Joseph Gatto Ravi Lanka Yumi Iwashita Adrian Stoica Single Sample Feature Importance: An Interpretable Algorithm for Low-Level Feature Analysis. 2019 abs/1911.11901 CoRR http://arxiv.org/abs/1911.11901 db/journals/corr/corr1911.html#abs-1911-11901

Madhusudan Basak Philip Bohlman Timothy E. Burdick Diane J. Cook Sarah DeLozier Hassan Ghasemzadeh 0001 Sarah E. Greer Shoya Higa Ganza Belise Isingizwe Yumi Iwashita Garrett JohnstonGarrett M. Johnston Inas KhayalInas S. Khayal Norris Khoo Ryo Kurazume Ravi Lanka Abdullah Mamun Kazuto Nakashima Sarah Masud PreumSarah M. PreumSarah Preum Roshnik Rahat Rohan Ray Philip Resnik William Romano Parker Seegmiller Omar Sharif Yash Srivastava John A. Stankovic Adrian Stoica