Large language models for predicting postoperative complications: benefits, potential, and limitations of clinical use

Article information

Korean J Anesthesiol. 2026;79(3):257-258
Publication date (electronic) : 2026 May 11
doi : https://doi.org/10.4097/kja.26425
Department of Anesthesiology and Pain Medicine, Chuncheon Sacred Heart Hospital, Hallym University College of Medicine, Chuncheon, Korea
Corresponding author: Young-Suk Kwon, M.D., Ph.D. Department of Anesthesiology and Pain Medicine, Chuncheon Sacred Heart Hospital, Hallym University College of Medicine, 77 Sakju-ro, Chuncheon 24253, Korea Tel: +82-33-240-5271 Fax: +82-33-251-0941 Email: gettys@hallym.or.kr
Received 2026 April 17; Accepted 2026 April 22.

Postoperative complications are common and clinically significant, occurring in up to 31.5% of patients in a prospective study and ranging from minor wound infections to death [1]. These complications can lead to prolonged hospital stays and treatment, resulting in social and economic burdens owing to the increased use of medical resources. Evaluating and predicting various postoperative complications require an approach that includes preoperative risk-based optimization, intraoperative protective strategies, and active postoperative management. Preoperative risk prediction models offer several practical benefits, such as the ability to guide modifiable risk reduction strategies that can be applied immediately before a surgical decision and the utilization of widely available and standardized clinical variables.

Several methods have been introduced to evaluate and predict postoperative complications. The American College of Surgeons National Surgical Quality Improvement Program Surgical Risk Calculator develops regression models that predict eight outcomes based on preoperative risk factors, utilizing reliable multicenter clinical data [2]. As this general-purpose calculator predicts most surgical risks, it can assist in clinical decision-making. The Surgical Risk Preoperative Assessment System also predicts and evaluates the risk of postoperative complications using concise common risk and outcome variables applicable to a broad patient population [3]. In contrast, the Surgical Outcome Risk Tool is simple but limited to mortality [4]. Additionally, the New Zealand Population Risk Model predicts mortality using a population-specific model [5]. However, most of these traditional models rely on linear relationships, making it difficult to reflect complex physiological interactions and impossible to account for temporal changes.

Recently, with an emphasis on personalized and precision medicine, the use of AI-based models for evaluating and predicting postoperative complications has increased. AI models overcome the shortcomings of traditional models, enabling higher discrimination in outcome prediction and offering scalability for outcomes and variable modalities. Nevertheless, existing tree- or neural network-based AI models have limitations in data representation and scalability when dealing with large amounts of unstructured data, high heterogeneity, the need for multimodal integration, or difficult feature definitions [6]. In these cases, large language models (LLMs) can be effective.

LLMs inherently possess universal linguistic and knowledge structures based on extensive prior learning. Thus, LLMs can serve as a bridge to align and integrate heterogeneous variable names and data formats generated across different domains into a common standard based on ‘clinical significance’ [7]. Furthermore, because LLMs enable basic data classification and feature identification in new environments without the need for separate retraining, the generalization barrier for models may be lower. LLMs are suitable for automatically extracting clinically important keywords from text-based clinical records and test results and converting them into structured data and can generate high-dimensional features usable in existing predictive models by integrating unstructured information. Moreover, through contextual comparisons with other patient records, LLMs can infer the implications of missing values at a medically valid level and by correcting typos or inaccurate terminology in unstructured data to fit the context, can provide support for existing models through more refined data input.

A study conducted by Lee et al. [8] explored methods for predicting postoperative outcomes, including 30-day mortality, intensive care unit admissions, and acute renal injury, using an LLM. Through external and internal validation, the model demonstrated comparability with existing tree-based models, suggesting that LLMs can serve as a general-purpose alternative to existing task-specific machine learning models and highlighting their potential for future clinical applications. However, LLMs currently face several challenges that prevent their use as independent predictive tools for preoperative risk assessment. First, they are subject to hallucinations, which can lead to clinical risks due to erroneous inferences. Second, they exhibit interpretability issues such as extreme “black boxes” owing to astronomical parameters. Finally, the probability predictions are unstable due to overconfidence or the absence of probability outputs. Resolving these issues must be prioritized for clinicians to use LLMs as decision-making aids.

Notes

Funding

None.

Conflicts of Interest

Young-Suk Kwon has been a member of the editorial board of the Korean Journal of Anesthesiology. There were no other potential conflicts of interest relevant to this article.

References

1. Sinha S, Pankaj D, Kumar M, Sinha RK, Gopal K. Assessment of postoperative complications and their risk factors in general surgery using clavien-dindo classification. Bioinformation 2025;21:2166–70. 10.6026/973206300212166. 41170033.
2. Bilimoria KY, Liu Y, Paruch JL, Zhou L, Kmiecik TE, Ko CY, et al. Development and evaluation of the universal ACS NSQIP surgical risk calculator: a decision aid and informed consent tool for patients and surgeons. J Am Coll Surg 2013;217:833–42. 10.1016/j.jamcollsurg.2013.07.385. 24055383.
3. Meguid RA, Bronsert MR, Juarez-Colunga E, Hammermeister KE, Henderson WG. Surgical risk preoperative assessment system (SURPAS): III. Accurate preoperative prediction of 8 adverse outcomes using 8 predictor variables. Ann Surg 2016;264:23–31. 10.1097/sla.0000000000001678. 26928465.
4. Protopapa KL, Simpson JC, Smith NC, Moonesinghe SR. Development and validation of the Surgical Outcome Risk Tool (SORT). Br J Surg 2014;101:1774–83. 10.1002/bjs.9638.
5. Campbell D, Boyle L, Soakell-Ho M, Hider P, Wilson L, Koea J, et al. National risk prediction model for perioperative mortality in non-cardiac surgery. Br J Surg 2019;106:1549–57. 10.1002/bjs.11232.
6. Schouten D, Nicoletti G, Dille B, Chia C, Vendittelli P, Schuurmans M, et al. Navigating the landscape of multimodal AI in medicine: a scoping review on technical challenges and clinical applications. Med Image Anal 2025;105:103621. 10.1016/j.media.2025.103621. 40482561.
7. Sakai H, Lam SS. Large language models for health care text classification: systematic review. JMIR AI 2026;5e79202. 10.2196/79202. 41672471.
8. Lee J, Kim H, Kim L, Lim L, Lee HC, Lee H. Comparison of large language models and conventional machine learning in postoperative outcome prediction: a retrospective, multi-national development and validation study. Korean J Anesthesiol 2026;79:332–51. 10.4097/kja.25646. 41630546.

Article information Continued