{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T02:11:08Z","timestamp":1771467068181,"version":"3.50.1"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,4,18]],"date-time":"2024-04-18T00:00:00Z","timestamp":1713398400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/linproxy.fan.workers.dev:443\/https\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,4,18]],"date-time":"2024-04-18T00:00:00Z","timestamp":1713398400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/linproxy.fan.workers.dev:443\/https\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Chinese PLA General Hospital Youth Independent Innovation Research Project","award":["22QNFC146"],"award-info":[{"award-number":["22QNFC146"]}]},{"name":"The key project of the Eighth Medical Center of Chinese PLA General Hospital","award":["2021ZD001"],"award-info":[{"award-number":["2021ZD001"]}]},{"name":"Logistics research independent innovation project"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Big Data"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Predicting patient mortality risk facilitates early intervention in intensive care unit (ICU) patients at greater risk of disease progression. This study applies machine learning methods to multidimensional clinical data to dynamically predict mortality risk in ICU patients.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>A total of 33,798 patients in the MIMIC-III database were collected. An integrated model NIMRF (Network Integrating Memory Module and Random Forest) based on multidimensional variables such as vital sign variables and laboratory variables was developed to predict the risk of death for ICU patients in four non overlapping time windows of 0\u20131\u00a0h, 1\u20133\u00a0h, 3\u20136\u00a0h, and 6\u201312\u00a0h. Mortality risk in four nonoverlapping time windows of 12\u00a0h was externally validated on data from 889 patients in the respiratory critical care unit of the Chinese PLA General Hospital and compared with LSTM, random forest and time-dependent cox regression model (survival analysis) methods. We also interpret the developed model to obtain important factors for predicting mortality risk across time windows. The code can be found in <jats:ext-link xmlns:xlink=\"https:\/\/linproxy.fan.workers.dev:443\/http\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/linproxy.fan.workers.dev:443\/https\/github.com\/wyuexiao\/NIMRF\">https:\/\/linproxy.fan.workers.dev:443\/https\/github.com\/wyuexiao\/NIMRF<\/jats:ext-link>.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>The NIMRF model developed in this study could predict the risk of death in four nonoverlapping time windows (0\u20131\u00a0h, 1\u20133\u00a0h, 3\u20136\u00a0h, 6\u201312\u00a0h) after any time point in ICU patients, and in internal data validation, it is suggested that the model is more accurate than LSTM, random forest prediction and time-dependent cox regression model (area under receiver operating characteristic curve, or AUC, 0\u20131\u00a0h: 0.8015 [95% CI 0.7725\u20130.8304] vs. 0.7144 [95%] CI 0.6824\u20130.7464] vs. 0.7606 [95% CI 0.7300\u20130.7913] vs 0.3867 [95% CI 0.3573\u20130.4161]; 1\u20133\u00a0h: 0.7100 [95% CI 0.6777\u20130.7423] vs. 0.6389 [95% CI 0.6055\u20130.6723] vs. 0.6992 [95% CI 0.6667\u20130.7318] vs 0.3854 [95% CI 0.3559\u20130.4150]; 3\u20136\u00a0h: 0.6760 [95% CI 0.6425\u20130.7097] vs. 0.5964 [95% CI 0.5622\u20130.6306] vs. 0.6760 [95% CI 0.6427\u20130.7099] vs 0.3967 [95% CI 0.3662\u20130.4271]; 6\u201312\u00a0h: 0.6380 [0.6031\u20130.6729] vs. 0.6032 [0.5705\u20130.6406] vs. 0.6055 [0.5682\u20130.6383] vs 0.4023 [95% CI 0.3709\u20130.4337]). External validation was performed on the data of patients in the respiratory critical care unit of the Chinese PLA General Hospital. Compared with LSTM, random forest and time-dependent cox regression model, the NIMRF model was still the best, with an AUC of 0.9366 [95% CI 0.9157\u20130.9575 for predicting death risk in 0\u20131\u00a0h]. The corresponding AUCs of LSTM, random forest and time-dependent cox regression model were 0.9263 [95% CI 0.9039\u20130.9486], 0.7437 [95% CI 0.7083\u20130.7791] and 0.2447 [95% CI 0.2202\u20130.2692], respectively. Interpretation of the model revealed that vital signs (systolic blood pressure, heart rate, diastolic blood pressure, respiratory rate, and body temperature) were highly correlated with events of death.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>Using the NIMRF model can integrate ICU multidimensional variable data, especially vital sign variable data, to accurately predict the death events of ICU patients. These predictions can assist clinicians in choosing more timely and precise treatment methods and interventions and, more importantly, can reduce invasive procedures and save medical costs.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s40537-024-00896-8","type":"journal-article","created":{"date-parts":[[2024,4,18]],"date-time":"2024-04-18T10:19:24Z","timestamp":1713435564000},"update-policy":"https:\/\/linproxy.fan.workers.dev:443\/https\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Revisiting the potential value of vital signs in the real-time prediction of mortality risk in intensive care unit patients"],"prefix":"10.1186","volume":"11","author":[{"given":"Pan","family":"Pan","sequence":"first","affiliation":[]},{"given":"Yue","family":"Wang","sequence":"additional","affiliation":[]},{"given":"Chang","family":"Liu","sequence":"additional","affiliation":[]},{"given":"Yanhui","family":"Tu","sequence":"additional","affiliation":[]},{"given":"Haibo","family":"Cheng","sequence":"additional","affiliation":[]},{"given":"Qingyun","family":"Yang","sequence":"additional","affiliation":[]},{"given":"Fei","family":"Xie","sequence":"additional","affiliation":[]},{"given":"Yuan","family":"Li","sequence":"additional","affiliation":[]},{"given":"Lixin","family":"Xie","sequence":"additional","affiliation":[]},{"given":"Yuhong","family":"Liu","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,4,18]]},"reference":[{"key":"896_CR1","first-page":"260","volume":"32","author":"V Apgar","year":"1952","unstructured":"Apgar V. A proposal for a new method of evaluation of the newborn. Curr Res Anesth Analg. 1952;32:260\u20137.","journal-title":"Curr Res Anesth Analg"},{"key":"896_CR2","doi-asserted-by":"publisher","first-page":"591","DOI":"10.1097\/00003246-198108000-00008","volume":"9","author":"WA Knaus","year":"1981","unstructured":"Knaus WA, Zimmerman JE, Wagner DP, et al. APACHE-acute physiology and chronic health evaluation: a physiologically classification system. Crit Care Med. 1981;9:591.","journal-title":"Crit Care Med"},{"key":"896_CR3","doi-asserted-by":"publisher","first-page":"975","DOI":"10.1097\/00003246-198411000-00012","volume":"12","author":"J-R Le Gall","year":"1984","unstructured":"Le Gall J-R, et al. A simplified acute physiology score for ICU patients. Crit Care Med. 1984;12:975\u20137.","journal-title":"Crit Care Med"},{"issue":"12","key":"896_CR4","doi-asserted-by":"publisher","first-page":"1368","DOI":"10.1007\/BF01709553","volume":"22","author":"G Apolone","year":"1996","unstructured":"Apolone G, Bertolini G, et al. The performance of SAPS II in a cohort of patients admitted to 99 Italian ICUs: results from GiViTI. Intensive Care Med. 1996;22(12):1368\u201378.","journal-title":"Intensive Care Med"},{"issue":"2","key":"896_CR5","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1007\/s001340050313","volume":"23","author":"R Moreno","year":"1997","unstructured":"Moreno R, Morais P. Outcome prediction in intensive care: results of a prospective, multicenter, Portuguese study. Intensive Care Med. 1997;23(2):177\u201386.","journal-title":"Intensive Care Med"},{"issue":"1","key":"896_CR6","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1097\/00003246-199801000-00016","volume":"26","author":"M Rui","year":"1998","unstructured":"Rui M, Miranda DR, Fidler V, et al. Evaluation of two outcome prediction models on an independent database. Crit Care Med. 1998;26(1):50\u201361.","journal-title":"Crit Care Med"},{"issue":"6910","key":"896_CR7","doi-asserted-by":"publisher","first-page":"977","DOI":"10.1136\/bmj.307.6910.977","volume":"307","author":"KM Rowan","year":"1993","unstructured":"Rowan KM, Kerr JH, Major E, et al. Intensive Care Society\u2019s APACHE II study in Britain and Ireland\u2013II: outcome comparisons of intensive care units after adjustment for case mix by the American APACHE II method. BMJ Clin Res. 1993;307(6910):977\u201381.","journal-title":"BMJ Clin Res"},{"key":"896_CR8","doi-asserted-by":"publisher","first-page":"564","DOI":"10.1007\/BF01708097","volume":"22","author":"PG Bastos","year":"1996","unstructured":"Bastos PG, Sun X, Wagner DP, et al. Application of the APACHE III prognostic system in Brazilian intensive care units: a prospective multicenter study. Intensive Care Med. 1996;22:564\u201370.","journal-title":"Intensive Care Med"},{"issue":"8","key":"896_CR9","doi-asserted-by":"publisher","first-page":"1317","DOI":"10.1097\/00003246-199808000-00012","volume":"26","author":"JE Zimmerman","year":"1998","unstructured":"Zimmerman JE, Wagner DP, Draper EA, et al. Evaluation of acute physiology and chronic health evaluation III predictions of hospital mortality in an independent database. Crit Care Med. 1998;26(8):1317\u201326.","journal-title":"Crit Care Med"},{"issue":"9","key":"896_CR10","doi-asserted-by":"publisher","first-page":"2145","DOI":"10.1097\/00003246-200209000-00034","volume":"30","author":"MJ Popovich","year":"2002","unstructured":"Popovich MJ. If most intensive care units are graduating with honors, is it genuine quality or grade inflation? Crit Care Med. 2002;30(9):2145\u20136.","journal-title":"Crit Care Med"},{"issue":"5","key":"896_CR11","doi-asserted-by":"publisher","first-page":"1297","DOI":"10.1097\/01.CCM.0000215112.84523.F0","volume":"34","author":"JE Zimmerman","year":"2006","unstructured":"Zimmerman JE, Kramer AA, McNair DS, Malila FM. Acute physiology and chronic health evaluation (APACHE) IV: hospital mortality assessment for today\u2019s critically ill patients. Crit Care Med. 2006;34(5):1297\u2013310.","journal-title":"Crit Care Med"},{"issue":"6","key":"896_CR12","doi-asserted-by":"publisher","first-page":"R645","DOI":"10.1186\/cc3821","volume":"9","author":"JR Le Gall","year":"2005","unstructured":"Le Gall JR, Neumann A, Hemery F, Bleriot JP, Fulgencio JP, Garrigues B, Gouzes C, Lepage E, Moine P, Villers D. Mortality prediction using SAPS II: an update for French intensive care units. Crit Care. 2005;9(6):R645\u201352.","journal-title":"Crit Care"},{"key":"896_CR13","doi-asserted-by":"crossref","unstructured":"Ray S. A quick review of machine learning algorithms. In: 2019 international conference on machine learning, big data, cloud and parallel computing (COMITCon). 2019.","DOI":"10.1109\/COMITCon.2019.8862451"},{"issue":"2","key":"896_CR14","doi-asserted-by":"publisher","first-page":"1043","DOI":"10.1177\/1460458219850323","volume":"26","author":"A Awad","year":"2019","unstructured":"Awad A, et al. Predicting hospital mortality for intensive care unit patients: time-series analysis. Health Inform J. 2019;26(2):1043\u201359.","journal-title":"Health Inform J"},{"key":"896_CR15","doi-asserted-by":"crossref","unstructured":"Gong JJ, Naumann T, Szolovits P, Guttag JV. Predicting clinical outcomes across changing electronic health record systems. In: Proceedings of KDD\u201917, Halifax, NS, Canada. 2017. p. 9.","DOI":"10.1145\/3097983.3098064"},{"key":"896_CR16","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1038\/s41746-018-0029-1","volume":"1","author":"A Rajkomar","year":"2018","unstructured":"Rajkomar A, et al. Scalable and accurate deep learning with electronic health records. NPJ Digit Med. 2018;1:18.","journal-title":"NPJ Digit Med"},{"key":"896_CR17","doi-asserted-by":"crossref","unstructured":"Ghassemi M, Naumann T, Doshivelez F, et al. Unfolding physiological state: mortality modelling in intensive care units. In: ACM SIGKDD international conference on knowledge discovery & data mining. KDD; 2014.","DOI":"10.1145\/2623330.2623742"},{"key":"896_CR18","doi-asserted-by":"publisher","first-page":"2195","DOI":"10.1007\/s11517-020-02174-0","volume":"50","author":"G Zhang","year":"2020","unstructured":"Zhang G, Xu JM, Yu M, et al. A machine learning approach for mortality prediction only using non-invasive parameters. Med Biol Eng Comput. 2020;50:2195\u2013238.","journal-title":"Med Biol Eng Comput"},{"issue":"1","key":"896_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13054-019-2561-z","volume":"23","author":"SY Kim","year":"2019","unstructured":"Kim SY, Kim S, Cho J, Kim YS, Sol IS, Sung Y, et al. A deep learning model for real-time mortality prediction in critically ill children. Crit Care. 2019;23(1):1\u201310.","journal-title":"Crit Care"},{"issue":"6","key":"896_CR20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/cc7140","volume":"12","author":"LA Celi","year":"2008","unstructured":"Celi LA, Hinske LC, Alterovitz G, et al. An artificial intelligence tool to predict fluid requirement in the intensive care unit: a proof-of-concept study. Crit Care. 2008;12(6):1\u201317.","journal-title":"Crit Care"},{"issue":"1","key":"896_CR21","doi-asserted-by":"publisher","first-page":"276","DOI":"10.1186\/s12911-022-02026-x","volume":"22","author":"J Hu","year":"2022","unstructured":"Hu J, Kang XH, Xu FF, Huang KZ, Du B, Weng L. Dynamic prediction of life-threatening events for patients in intensive care unit. BMC Med Inform Decis Mak. 2022;22(1):276.","journal-title":"BMC Med Inform Decis Mak"},{"key":"896_CR22","doi-asserted-by":"crossref","unstructured":"Allen D. Automatic one-hot re-encoding for FPLs. In: Selected papers from the second international workshop on field-programmable logic and applications, FieldProgrammable gate arrays: architectures and tools for rapid prototyping. London: Springer-Verlag. 1993. p. 71\u20137.","DOI":"10.1007\/3-540-57091-8_31"},{"issue":"8","key":"896_CR23","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J. Long short-term memory. Neural Comput. 1997;9(8):1735\u201380.","journal-title":"Neural Comput"},{"key":"896_CR24","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman L. Random forest. Mach Learn. 2001;45:5\u201332.","journal-title":"Mach Learn"},{"issue":"2","key":"896_CR25","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1111\/j.2517-6161.1972.tb00899.x","volume":"34","author":"DR Cox","year":"1972","unstructured":"Cox DR. Regression models and life tables. J R Stat Soc Ser B. 1972;34(2):187\u2013220.","journal-title":"J R Stat Soc Ser B"},{"key":"896_CR26","unstructured":"Citi L, Barbieri R. PhysioNet 2012 challenge: predicting mortality of ICU patients using a cascaded SVM-GLM paradigm. In: Computing in cardiology; IEEE. 2013."},{"key":"896_CR27","doi-asserted-by":"crossref","unstructured":"Chang D, Chang D, Pourhomayoun M. Risk prediction of critical vital signs for ICU patients using recurrent neural network. In: 2019 international conference on computational science and computational intelligence (CSCI 2019), 5\u20137 Dec. 2019, Las Vegas, NV, USA. 2019. p. 1003\u20136.","DOI":"10.1109\/CSCI49370.2019.00191"},{"key":"896_CR28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1177\/2054358118776326","volume":"5","author":"H Mohamadlou","year":"2018","unstructured":"Mohamadlou H, Lynn-Palevsky A, Barton C, et al. Prediction of acute kidney injury with a machine learning algorithm using electronic health record data. Can J Kidney Health Dis. 2018;5:1\u20139.","journal-title":"Can J Kidney Health Dis"},{"issue":"11","key":"896_CR29","doi-asserted-by":"publisher","first-page":"1582","DOI":"10.1007\/s00134-022-06890-z","volume":"48","author":"SV Bhavani","year":"2022","unstructured":"Bhavani SV, Semler M, Qian ET, Verhoef PA, Robichaux C, Churpek MM, Coopersmith CM. Development and validation of novel sepsis subphenotypes using trajectories of vital signs. Intensive Care Med. 2022;48(11):1582\u201392.","journal-title":"Intensive Care Med"},{"issue":"1","key":"896_CR30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41467-021-20910-4","volume":"12","author":"KH Goh","year":"2021","unstructured":"Goh KH, Wang L, Yeow A, et al. Artifcial intelligence in sepsis early prediction and diagnosis using unstructured data in healthcare. Nat Commun. 2021;12(1):1\u201310.","journal-title":"Nat Commun"}],"container-title":["Journal of Big Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/linproxy.fan.workers.dev:443\/https\/link.springer.com\/content\/pdf\/10.1186\/s40537-024-00896-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/linproxy.fan.workers.dev:443\/https\/link.springer.com\/article\/10.1186\/s40537-024-00896-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/linproxy.fan.workers.dev:443\/https\/link.springer.com\/content\/pdf\/10.1186\/s40537-024-00896-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,18]],"date-time":"2024-04-18T10:25:14Z","timestamp":1713435914000},"score":1,"resource":{"primary":{"URL":"https:\/\/linproxy.fan.workers.dev:443\/https\/journalofbigdata.springeropen.com\/articles\/10.1186\/s40537-024-00896-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,18]]},"references-count":30,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["896"],"URL":"https:\/\/linproxy.fan.workers.dev:443\/https\/doi.org\/10.1186\/s40537-024-00896-8","relation":{},"ISSN":["2196-1115"],"issn-type":[{"value":"2196-1115","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,18]]},"assertion":[{"value":"1 June 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 February 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 April 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Yes, consent is granted.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Yes, consent is granted for publication.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"53"}}