Transparency considerations for describing statistical analyses in research

Sang Kyu Kwak; Jonghae Kim

doi:10.4097/kja.21203

Korean J Anesthesiol > Volume 74(6); 2021 > Article

Kwak and Kim: Transparency considerations for describing statistical analyses in research

Statistical Round

Korean Journal of Anesthesiology 2021;74(6):488-495.

Published online: November 17, 2021

DOI: https://doi.org/10.4097/kja.21203

Transparency considerations for describing statistical analyses in research

Sang Kyu Kwak¹

, Jonghae Kim²

¹Department of Medical Statistics, Daegu Catholic University School of Medicine, Daegu, Korea

²Department of Anesthesiology and Pain Medicine, Daegu Catholic University School of Medicine, Daegu, Korea

Corresponding author: Jonghae Kim, M.D.

Department of Anesthesiology and Pain Medicine, Daegu Catholic University School of Medicine, 33 Duryugongwon-ro 17-gil, Nam-gu, Daegu 42472, Korea

Tel: +82-53-650-4979

Fax: +82-53-650-4517

Email: usmed12@gmail.com; usmed@cu.ac.kr

Received May 14, 2021 Revised September 23, 2021 Accepted October 17, 2021

This is an open-access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Researchers who use the results of statistical analyses to draw conclusions about collected data must write a statistical analysis section in their manuscript. Describing statistical analyses in precise detail is as important as presenting the dosages of drugs and methodology of interventions. It is also essential for scientific accuracy and transparency in scientific research. We evaluated the quality of the statistical analysis sections of clinical research articles published in the Korean Journal of Anesthesiology between February 2020 and February 2021. Using a Likert scale where 1, 2, and 3 represented “not described at all,” “partially described,” and “fully described,” respectively, the following 6 items were assessed: 1) stating of the statistical analysis methods used, 2) rationale for and detailed description of the statistical analysis methods used, 3) parameters derived from the statistical analyses, 4) type and version of the statistical software package used, 5) significance level, and 6) sidedness of the test (one-sided vs. two-sided). The first 3 items evaluate issues directly related to the statistical analysis methods used and last 3 are indirectly related items. In all the included articles, the statistical analysis methods used were stated (score of 3). However, only 4 articles (12.9%) fully described the sidedness of the test (score of 3). Authors tend not to describe the sidedness of statistical analysis tests in the methodology section of clinical research articles. It is essential that the sidedness be described in research studies.

Keywords: Data analysis; Probability; Research; Software; Statistical data interpretation; Statistics.

Introduction

Depending on the type of data presented and the hypothesis of a study, a variety of statistical methods are used for analyzing clinical data. In particular, several journals require authors to be vigilant not only about performing statistical analyses, but also about providing raw data for their research. Therefore, it is necessary to describe clearly and specifically the statistical analysis methods used, how they were used, and the parameters derived from the statistical analysis methods. Accordingly, researchers must describe the statistical analyses in detail in the methods section of research proposals, results reports, theses, or articles. By reading the statistical analyses described in the methods section, readers should be able to understand what statistical analysis methods were used in the study, the reasons they were used, and the parameters presented as results. The statistical analysis software used, pre-set significance level, and sidedness of the test (two-sided or one-sided) should also be easily determinable by the readers. Readers should be able to reproduce the statistical analysis of a study if the raw data are provided. The statistical analysis section should therefore include the following: 1) stating of the statistical analysis methods used, 2) rationale for and detailed description of these statistical analysis methods, 3) presentation of the statistical parameters produced by the statistical analysis methods, 4) type and version of the statistical software package used, 5) significance level, and 6) sidedness of the statistical test (one-sided vs. two-sided).

In this study, the statistical analysis sections of 31 clinical research papers published in the Korean Journal of Anesthesiology (KJA) between February 2020 and February 2021 were evaluated using the above-mentioned 6 items. Through this process, practical ways of increasing the transparency of research to build scientific evidence are presented.

Materials and Methods

In this study, the statistical analysis sections of clinical research papers published in the KJA between February 2020 and February 2021 were evaluated. The sample size calculation was not assessed. Editorials, review articles, statistical round articles, case reports, letters to the editor, and corrigendum, all of which do not include statistical analysis sections, were excluded from the analysis. Additionally, the statistical analysis sections of experimental studies were not evaluated.

Evaluation items directly related to statistical analyses

Stating the statistical analysis methods used

Statistical analyses are used to calculate the significance probability (probability value) of the test statistic (estimated based on the probability distribution corresponding to the statistical analysis method used) to test the hypothesis of a study. There are various probability distributions of test statistics, including t distribution, F distribution, and chi-square distribution. For example, if the distribution of the test statistic is a t-distribution, the statistical analysis method is called a t-test. However, various statistical analysis methods use the t distribution: a one-sample t-test, an independent two-sample t-test, and a paired t-test. Therefore, the name of the statistical analysis methods used should be specifically and accurately presented.

Rationale for and detailed description of the statistical analysis methods used

Although the general descriptions of statistical analysis methods are readily available in related books, finding the best statistical analysis methods consistent with the research design and hypothesis is another issue. Hence, the rationale for using the statistical analysis methods should be clearly described in the statistical analysis section. If a t-test is used to assess the probability of the t-statistic calculated from the mean difference between 2 independent groups, researchers can simply state that the t-test was used to evaluate the statistical significance of the mean difference of the quantitative data between the 2 groups. However, some complicated statistical analysis methods require several steps and require the consideration of various factors. For example, when performing multiple linear regression or multiple logistic regression analyses, the variable selection method should be specified. If a principal component analysis is performed, the factor rotation method should be clear. Additionally, to fully and accurately describe propensity score matching, the adjustment method, caliper value, and ratio of pair-matching must be stated. Therefore, the statistical analysis section should describe in detail the rationale and steps taken for the statistical analysis methods used.

Parameters derived from statistical analysis methods

To test the hypothesis of a research study, statistics are estimated by a statistical analysis method. Statistics are used as the results of data analyses and determine whether the hypothesis is correct. For example, if a t-test is used to test whether there is a significant difference in means between 2 independent groups, the means and standard deviations of each group and the probability value that determines the significance of the mean difference are presented. The mean difference between the 2 groups and pooled standard deviation should be presented. If a logistic regression analysis is performed, the following parameters can be presented: the odds ratios of each variable with their 95% CIs and the probability value that determines whether the odds ratios are statistically different from 1, that is, whether the odds ratios are significant or not. Therefore, the parameters that are derived from statistical analysis methods and used as the results of a study, need to be presented in detail.

Evaluation items indirectly related to statistical analysis methods

Type and version of statistical software package used

Various statistical software packages are available, such as IBM SPSS Statistics (www.ibm.com/products/spss-statistics), R (www.r-project.org), SAS (www.sas.com), Minitab (www.minitab.com), MedCalc (www.medcalc.org), NCSS (www.ncss.com/software), and Excel (www.microsoft.com/en-us/microsoft-365/excel). The versions of these software packages are updated as new functions are added or old functions are upgraded. Since they have different manufacturers, the algorithms or methods used for the statistical analyses may be different. That is, the common statistical analyses with common data performed by different statistical software packages can produce results that are different from each other. Therefore, information regarding the software and the version used for statistical analyses should be clearly stated in the statistical analysis section.

Significance level

It is mandatory to include the significance level for statistical hypothesis testing since conclusions are directly drawn from it. The significance level is the maximum probability that a type I error (an error of rejecting the null hypothesis even though the null hypothesis is correct) is tolerable. In a statistical hypothesis test, the calculated probability value is compared with the significance level set by the researcher to determine whether the null hypothesis can be rejected. The significance level was set at 0.05 (5%) in all 31 articles analyzed in this study. If the significance level is set at a relatively high value, such as 20% or 30%, rather than 5%, the results of the study may be unreliable. Therefore, the significance level is generally set no higher than 5%. Occasionally, the significance level is set at 1%. This does not mean that setting a significance level of 10% is incorrect. The authors should only clearly state that the significance level was set at 10%. Therefore, the significance level should be explicitly presented in the statistical analysis section.

Sidedness of the test (one-sided vs. two-sided)

Statistical hypothesis testing builds null and alternative hypotheses and is used to determine whether to reject the null hypothesis through a series of processes. To indicate inequality when formulating an alternative hypothesis, the symbol, “≠” should be used if the test is two-sided and “>” or “<” should be used if the test is one-sided. For example, if a two-sided t-test is used to determine whether the mean difference between 2 independent groups (A and B) is significant, the null hypothesis (H₀) and the alternative hypothesis (H_a) are as follows:

(1)

H0 : μA = μB vs. Ha : μA ≠ μB

where μ_A is the population mean of group A, and μ_B is the population mean of group B.

If a one-sided t-test is used to test whether the mean of one of 2 independent groups is significantly greater or less than the other, H₀ and H_a are shown as follows:

(2)

H0 : μA =μB vs. Ha : μA > μB or H0 : μA = μB vs. Ha : μA < μB

The range of the t-statistic to determine statistical significance depends on the sidedness of the test. Likewise, different probability values are calculated according to the sidedness of the test. The probability value of a two-sided test is 2 times that of a one-sided test. Since statistical software packages give the results from two-sided tests by default, the setting of the sidedness of the tests should be changed for one-sided tests. Therefore, the sidedness of tests (two-sided or one-sided) should be accurately described in the statistical analysis section.

Assessment of each evaluation item

A 3-level Likert scale was used to score the above-mentioned 6 items. Each item received a score of 3 (★★★) if they were fully described, 2 (★★) if they were partially described, or 1 (★) if they were not described at all. Two researchers independently conducted the evaluation. In the event of a disagreement between the 2 researchers, a consensus was achieved by discussion and through referring to the original text.

Example assessments of well-written statistical analysis sections

In the study conducted by Makarem et al. [1], the statistical analysis section stated the following:

“This study was conducted as a prospective observational study. Three emergence groups were defined as agitated, normal, and hypoactive. Demographic and descriptive data analyses were done for the study population and the 3 groups above. Frequencies were expressed as counts (percentage) and continuous variables as mean with standard deviation (SD). After testing the normality with the Kolmogorov-Smirnov test, we used the Student’s t-test and the chi-squared test for univariate analysis. We performed multivariate analyses using a backward binary stepwise logistic regression to examine and determine the odds ratios (OR) of the risk factors for inadequate emergence, with 95% confidence for the CI. Furthermore, the statistical analyses (both univariate and multivariate) were also conducted in the subgroup of patients with a history of substance dependence. We made no adjustments for multiple testing in all these exploratory data analyses. SPSS ver. 22.0 software (IBM Corp., USA) was used for analyses, and the study considered P < 0.05 (two-sided) as significant.”

The statistical analysis methods that the authors used in this study were the Kolmogorov-Smirnov test, Student’s t-test, chi-squared test, and binary stepwise logistic regression (3 points). Concerning the rationale of each statistical analysis method, the Kolmogorov-Smirnov test was used to test the normality of the data, the Student’s t-test and chi-squared test were used for the univariate analysis, and the binary stepwise logistic regression was performed to determine the odds ratios of the risk factors for inadequate emergence. In particular, the variable selection method for binary logistic regression was stepwise selection¹⁾ (3 points). According to the type of data or statistical analysis methods used, the statistics were presented as counts (percentages) for frequencies, mean with standard deviation for continuous variables, and odds ratio (95% CI) for the logistic regression analysis results (3 points). The statistical analysis software package used was SPSS software ver. 22.0 (IBM Corp., USA) (3 points), the significance level was set at 0.05 (3 points), and a two-sided test was used (3 points).

Another example of a statistical analysis section, taken from a study conducted by Kaur et al. [2], is as follows:

“The normality of continuous variables was assessed using the Shapiro-Wilk test. Normally distributed continuous variables are presented as the mean ± SD, whereas ordinal variables (NRS score) are presented as the mean ± SD (median). Means were also used to describe the ordinal data along with median. A one-way analysis of variance was used to compare the means among the three independent groups. The Kruskal-Wallis test was used followed by multiple comparisons (Bonferroni test) to compare the distribution of the NRS pain scores among the three study groups. A paired sample t-test was used to test the change in means between the pre to post observations. Fisher’s exact test was used to compare the proportions between the groups. A two-sided P value of < 0.05 was considered statistically significant. Statistical Package for Social Sciences, version 23 (SPSS-23, IBM Corp., USA) was used for data analysis.”

The statistical analysis methods used in this study were the Shapiro-Wilk test, one-way analysis of variance, Kruskal-Wallis test, paired sample t-test, and Fisher’s exact test (3 points). With regard to the rationale for each statistical analysis method used, the Shapiro-Wilk test was used to test the normality of the data, the one-way analysis of variance was used to compare the means among the 3 independent groups, the Kruskal Wallis test was used to compare the distribution of the NRS pain scores among the 3 study groups, the paired sample t-test was used to test the change in means between the pre- and post-observations, Fisher’s exact test was used to compare the proportions between the groups, and the Bonferroni test was used to adjust the probability values for multiple comparisons (3 points). According to the type of data, the statistics were presented as means ± standard deviations for normally distributed continuous variables and means ± standard deviations (median) for ordinal variables (3 points). The statistical analysis software package used was Statistical Package for Social Sciences version 23 (SPSS v.23, IBM Corp., USA) (3 points), the significance level was set at 0.05 (3 points), and two-sided tests were used (3 points).

The above methodology was applied to assess the statistical analysis sections of the remaining articles.

Results

From February 2020 to February 2021, a total of 111 papers were published in the KJA. Among them, 31 clinical research articles were included in the analysis after 10 editorials, 16 review articles, 5 statistical round articles, 15 case reports, 30 letters to editor, and 4 experimental studies were excluded.

The evaluation items, from highest to lowest rankings, are as follows: stating of the statistical analysis methods used, type and version of statistical software package, significance level, parameters derived from statistical analysis methods, rationale for and detailed description of the statistical analysis methods used, and sidedness of statistical tests (Table 1). All 31 articles stated the statistical analysis methods used appropriately (score of 3). Of the 31 articles, 29 (93.5%) presented the type and version of the statistical software package used (score of 3). The number (percentage) of the articles that received a score of 3 for the two items (parameters derived from statistical analysis methods and rationale for and details of statistical analysis methods) was 24 (77.4%) and 23 (74.2%), respectively. The studies by Lee et al. [3] and Hervás et al. [4] received scores of 2 for the “rationale for and details of the statistical analysis methods used” item because, although they stated that they used propensity score matching, no descriptions of the adjustment method, caliper value, or the ratio of pair-matching were found, which would significantly affect the results of the subsequent statistical analysis. Likewise, the papers by Lim et al. [5] and Tamboli et al. [6] reported performing statistical analyses without describing the rationale for and details of the statistical analysis methods used. Thus, they each received a score of 2 for this item. Lastly, the sidedness of statistical tests (one-sided vs. two-sided) was explicitly described in only 4 (12.9%) of the 31 articles, which was the lowest ranked evaluation item.

Discussion

Surprisingly, most of the articles did not specify the sidedness of the statistical tests used. The KJA author guidelines do not explicitly request the sidedness of statistical tests be included. However, it requires that probability values should be two-tailed except for study designs that require a one-tailed test. Since most of the authors of clinical research articles perform two-tailed tests, the readers are likely to think that the tests are two-tailed unless otherwise specified. However, it is not best practice to omit important information conventionally in scientific papers that must provide accurate information.

There are several important reasons why statistical analysis sections should include information on the 6 items mentioned in this article. First, scientific evidence should be available to support the appropriate use of statistical methods to test the research hypothesis. For example, it is inappropriate to perform parametric tests using data that do not fulfill the normality assumption. Instead, non-parametric tests should be performed for non-normally distributed data. Performing a t-test twice (A vs. B and A vs. C) or 3 times (A vs. B, A vs. C, and B vs. C) to compare the means of 3 independent groups (A, B, and C) is also inappropriate. One-way analysis of variance should be used to test the null hypothesis regarding the difference in means of 3 groups. If the null hypothesis is rejected, a post-hoc test is necessary. Second, the transparency of a study can be ensured by describing how the statistical analysis method was performed with the type and version of the statistical software package, significance level, and the sidedness of statistical tests used. For example, when performing logistic regression analyses, whether covariates are included (and if so, which covariates) and the significance level of the univariate analyses, which is used to determine which independent variables to include in the multivariable analysis, should be described. In propensity score matching, the results of the analysis vary depending on the propensity score correction method, caliper value, and the ratio of pair-matching, and thus these should be described in detail. The type and version of the statistical software package, significance level, and sidedness of the tests should also be presented. Third, describing the rationale or purpose for choosing the selected analysis methods provides evidence that the analyses were appropriate to reveal the causal relationship between the variables measured in the study, making it scientific. For example, when an independent two-sample t-test is used, a statement such as “After the normality assumption had been met by the Kolmogorov-Smirnov test, independent two-sample t-test was used to compare the pain scores between the 2 analgesics” could be used.

However, an important limitation of this study should be considered. We did not check whether the results of all the statistical analyses described in the statistical analysis section were presented clearly in the results section. It is therefore unclear whether the results of the statistical analyses that were not described in the statistical analysis section are presented in the results section. However, we believe that the peer review system of this journal has already resolved this issue.

Researchers need to recognize what should be included when describing statistical analyses in research proposals, results reports, theses, and articles. The inclusion of the above-mentioned items, which are directly and indirectly related to statistical analyses, in the methodology section improves the transparency and scientific nature of a study. In particular, for complicated analyses or the use of multiple statistical analyses, more effort to describe the essential points we have proposed is needed to clarify how the presented results were obtained. While it is difficult to generalize our results since we did not assess all articles that have been published, we emphasize that researchers should pay particular attention to the items that were rated poorly in this study (sidedness of statistical tests [one-sided vs. two-sided], rationale for and details of the statistical analysis methods used, and parameters derived from statistical analysis methods) and should describe them clearly in their statistical analysis sections.

NOTES

1) It is unclear whether the authors performed backward elimination or stepwise selection to select the variables to be included in the regression model because they used the unclear term, “backward binary stepwise logistic regression.”

NOTES

Funding

None.

Conflicts of Interest

No potential conflict of interest relevant to this article was reported.

Author Contributions

Sang Kyu Kwak (Conceptualization; Data curation; Formal analysis; Investigation; Methodology; Software; Supervision; Validation; Writing – original draft; Writing – review & editing)

Jonghae Kim (Conceptualization; Data curation; Formal analysis; Investigation; Methodology; Project administration; Supervision; Validation; Writing – original draft; Writing – review & editing)

Table 1.

Assessment of Statistical Analysis Sections of 31 Clinical Research Articles Published in the Korean Journal of Anesthesiology between February 2020 and February 2021

No.	Last name of first author	Year	Volume	Issue	Evaluation items
No.	Last name of first author	Year	Volume	Issue	1	2	3	4	5	6
1	Gautam [7]	2021	74	1	★★★	★★★	★	★★★	★★★	★
2	Lee [3]	2021	74	1	★★★	★★	★★★	★★★	★★★	★
3	Hervás [4]	2021	74	1	★★★	★★	★★★	★★★	★	★
4	Choi [8]	2021	74	1	★★★	★★★	★★★	★★★	★★★	★
5	Burton [9]	2021	74	1	★★★	★★★	★★★	★★★	★★★	★
6	Lee [10]	2020	73	6	★★★	★★★	★★★	★★★	★★★	★
7	Efremov [11]	2020	73	6	★★★	★★★	★★★	★★★	★★★	★
8	Lee [12]	2020	73	6	★★★	★★★	★★★	★★★	★★★	★
9	Ashoor [13]	2020	73	6	★★★	★	★★★	★★★	★★★	★
10	Ryu [14]	2020	73	6	★★★	★★★	★★★	★★★	★★★	★
11	Kaur [2]	2020	73	5	★★★	★★★	★★★	★★★	★★★	★★★
12	Gadsden [15]	2020	73	5	★★★	★★★	★★★	★★★	★★★	★
13	Lim [5]	2020	73	5	★★★	★★	★★★	★★★	★★★	★★★
14	Tamboli [6]	2020	73	5	★★★	★★	★★★	★★★	★★★	★
15	Aoyama [16]	2020	73	4	★★★	★★	★★★	★★★	★★★	★
16	Chadha [17]	2020	73	4	★★★	★★★	★	★★★	★	★★★
17	Banik [18]	2020	73	4	★★★	★	★★★	★	★★★	★
18	Makarem [1]	2020	73	4	★★★	★★★	★★★	★★★	★★★	★★★
19	Udupi [19]	2020	73	3	★★★	★★★	★	★★★	★★★	★
20	Boscolo [20]	2020	73	3	★★★	★★★	★★	★★★	★	★
21	Said [21]	2020	73	3	★★★	★★★	★★	★★★	★★★	★
22	Azemati [22]	2020	73	3	★★★	★★★	★★★	★★★	★★★	★
23	Srivastava [23]	2020	73	2	★★★	★★★	★	★★★	★★★	★
24	An [24]	2020	73	2	★★★	★★★	★	★	★	★
25	Na [25]	2020	73	2	★★★	★★★	★★★	★★★	★★★	★
26	Salama [26]	2020	73	2	★★★	★	★★★	★★★	★★★	★
27	Doo [27]	2020	73	1	★★★	★★★	★★★	★★★	★★★	★
28	Park [28]	2020	73	1	★★★	★★★	★★★	★★★	★★★	★
29	Ökmen [29]	2020	73	1	★★★	★★★	★★★	★★★	★★★	★
30	Choi [30]	2020	73	1	★★★	★★★	★★★	★★★	★★★	★
31	Danforth [31]	2020	73	1	★★★	★★★	★★★	★★★	★★★	★
Number (percentage) of each score
★					0 (0.0)	3 (9.7)	5 (16.1)	2 (6.5)	4 (12.9)	27 (87.1)
★★					0 (0.0)	5 (16.1)	2 (6.5)	0 (0.0)	0 (0.0)	0 (0.0)
★★★					31 (100)	23 (74.2)	24 (77.4)	29 (93.5)	27 (87.1)	4 (12.9)
[Evaluation items]
1 Stating the statistical analysis methods used
2 Rationale for and detailed description of statistical analysis methods used
3 Parameters derived from statistical analysis methods
4 Type and version of statistical software package used
5 Significance level
6 Sidedness of statistical test (one-sided vs. two-sided)
[Symbols]
★: not described at all
★★: partially described
★★★: fully described

References

1. Makarem J, Larijani AH, Eslami B, Jafarzadeh A, Karvandian K, Mireskandari SM. Risk factors of inadequate emergence following general anesthesia with an emphasis on patients with substance dependence history. Korean J Anesthesiol 2020; 73: 302-10.

2. Kaur U, Shamshery C, Agarwal A, Prakash N, Valiveru RC, Mishra P. Evaluation of postoperative pain in patients undergoing modified radical mastectomy with pectoralis or serratus-intercostal fascial plane blocks. Korean J Anesthesiol 2020; 73: 425-33.

3. Lee JH, Heo HJ, Kim YY, Baek SM, Kim KM, Jung DW. The effect of interscalene brachial plexus block with propofol sedation on preventing perioperative hypothermia during arthroscopic shoulder surgery. Korean J Anesthesiol 2021; 74: 53-8.

4. Hervás MS, Játiva-Porcar R, Robles-Hernández D, Rubert AS, Segarra B, Oliva C, et al. Evaluation of the relationship between lactacidemia and postoperative complications after surgery for peritoneal carcinomatosis. Korean J Anesthesiol 2021; 74: 45-52.

5. Lim YC, Koo ZK, Ho VW, Chang SS, Manohara S, Tong QJ. Randomized, controlled trial comparing respiratory and analgesic effects of interscalene, anterior suprascapular, and posterior suprascapular nerve blocks for arthroscopic shoulder surgery. Korean J Anesthesiol 2020; 73: 408-16.

6. Tamboli M, Leng JC, Hunter OO, Kou A, Mudumbai SC, Memtsoudis SG, et al. Five-year follow-up to assess long-term sustainability of changing clinical practice regarding anesthesia and regional analgesia for lower extremity arthroplasty. Korean J Anesthesiol 2020; 73: 401-7.

7. Gautam S, Agarwal A, Das PK, Khuba S, Kumar S. Prevention of epidural catheter migration: a comparative evaluation of two tunneling techniques. Korean J Anesthesiol 2021; 74: 59-64.

8. Choi JW, Kim DK, Jeong HJ, Kim YR, Chung YJ, Son YH. Risk factors associated with hypotensive bradycardic events during open shoulder surgery in the beach chair position. Korean J Anesthesiol 2021; 74: 38-44.

9. Burton BN, Finneran JJ, Angerstein A, Ross E, Mitchell A, Waterman RS, et al. Demographic and clinical factors associated with same-day discharge and unplanned readmission following shoulder arthroplasty: a retrospective cohort study. Korean J Anesthesiol 2021; 74: 30-7.

10. Lee JH, Kim Y, Mun J, Lee J, Ko S. Effects of hypercarbia on arterial oxygenation during one-lung ventilation: prospective randomized crossover study. Korean J Anesthesiol 2020; 73: 534-41.

11. Efremov SM, Kozireva VS, Moroz GB, Abubakirov MN, Shkoda OS, Shilova AN, et al. The immunosuppressive effects of volatile versus intravenous anesthesia combined with epidural analgesia on kidney cancer: a pilot randomized controlled trial. Korean J Anesthesiol 2020; 73: 525-33.

12. Lee JH, Yoon DH, Heo BH. Incidence of newly developed postoperative low back pain with median versus paramedian approach for spinal anesthesia. Korean J Anesthesiol 2020; 73: 518-24.

13. Ashoor TM, Hasseb AM, Esmat IM. Nebulized heparin and salbutamol versus salbutamol alone in acute exacerbations of chronic obstructive pulmonary disease requiring mechanical ventilation: a double-blind randomized controlled trial. Korean J Anesthesiol 2020; 73: 509-17.

14. Ryu T, Kim BJ, Woo SJ, Lee SY, Lim JA, Kwak SG, et al. Retrospective analysis of risk factors of hypotensive bradycardic events during shoulder arthroscopic surgery under interscalene blockade in the sitting position. Korean J Anesthesiol 2020; 73: 542-9.

15. Gadsden JC, Sata S, Bullock WM, Kumar AH, Grant SA, Dooley JR. The relative analgesic value of a femoral nerve block versus adductor canal block following total knee arthroplasty: a randomized, controlled, double-blinded study. Korean J Anesthesiol 2020; 73: 417-24.

16. Aoyama Y, Sakura S, Abe S, Wada M, Saito Y. Analgesic effects and distribution of cutaneous sensory blockade of quadratus lumborum block type 2 and posterior transversus abdominis plane block: an observational comparative study. Korean J Anesthesiol 2020; 73: 326-33.

17. Chadha RM, Dexter F, Brull SJ. Lack of recall after sedation for cataract surgery and its effect on the validity of measuring patient satisfaction. Korean J Anesthesiol 2020; 73: 319-25.

18. Banik S, Rath GP, Lamsal R, Bithal PK. Effect of dexmedetomidine on dynamic cerebral autoregulation and carbon dioxide reactivity during sevoflurane anesthesia in healthy patients. Korean J Anesthesiol 2020; 73: 311-8.

19. Udupi S, Puri K. A novel approach to bedside pretransfusion identity check of blood and its components: the Sandesh Positive-Negative protocol. Korean J Anesthesiol 2020; 73: 232-8.

20. Boscolo A, Spiezia L, Campello E, Bertini D, Lucchetta V, Piasentini E, et al. Whole-blood hypocoagulable profile correlates with a greater risk of death within 28 days in patients with severe sepsis. Korean J Anesthesiol 2020; 73: 224-31.

21. Said ET, Sztain JF, Martin EI, Abramson WB, Meineke MN, Furnish TJ, et al. Association of trainee involvement in an acute pain service with postoperative opioid use in patients undergoing cytoreductive surgery with hyperthermic intraperitoneal chemotherapy. Korean J Anesthesiol 2020; 73: 219-23.

22. Azemati S, Pourali A, Aghazadeh S. Effects of adding dexmedetomidine to local infiltration of bupivacaine on postoperative pain in pediatric herniorrhaphy: a randomized clinical trial. Korean J Anesthesiol 2020; 73: 212-8.

23. Srivastava VK, Agrawal S, Deshmukh SA, Noushad F, Khan S, Kumar R. Efficacy of trospium for prevention of catheter-related bladder discomfort: a prospective, randomized, placebo-controlled, double-blind study. Korean J Anesthesiol 2020; 73: 145-50.

24. An J, Noh H, Kim E, Lee J, Woo K, Kim H. Neuromuscular blockade reversal with sugammadex versus pyridostigmine/glycopyrrolate in laparoscopic cholecystectomy: a randomized trial of effects on postoperative gastrointestinal motility. Korean J Anesthesiol 2020; 73: 137-44.

25. Na SH, Shin CS, Kim GH, Kim JH, Lee JS. Long-term mortality of patients discharged from the hospital after successful critical care in the ICU in Korea: a retrospective observational study in a single tertiary care teaching hospital. Korean J Anesthesiol 2020; 73: 129-36.

26. Salama ER. Ultrasound-guided bilateral quadratus lumborum block vs. intrathecal morphine for postoperative analgesia after cesarean section: a randomized controlled trial. Korean J Anesthesiol 2020; 73: 121-8.

27. Doo AR, Kang S, Kim YS, Lee TW, Lee JR, Kim DC. The effect of the type of anesthesia on the quality of postoperative recovery after orthopedic forearm surgery. Korean J Anesthesiol 2020; 73: 58-66.

28. Park SH, Park S, Lee S, Choi JI, Bae HB, You Y, et al. Effect of transportation method on preoperative anxiety in children: a randomized controlled trial. Korean J Anesthesiol 2020; 73: 51-7.

29. Ökmen K, Ökmen BM. Ultrasound-guided anterior quadratus lumborum block for postoperative pain after percutaneous nephrolithotomy: a randomized controlled trial. Korean J Anesthesiol 2020; 73: 44-50.

30. Choi EJ, Choi YJ, Lee SW, Choi YM, Ri HS, Park JY, et al. Effect of anesthetic method on incidence of delirium after total hip replacement arthroplasty in South Korea: a population-based study using National Health Insurance claims data. Korean J Anesthesiol 2020; 73: 36-43.

31. Danforth D, Gabriel RA, Clark AI, Newhouse B, Khoche S, Vig S, et al. Preoperative risk factors for massive transfusion, prolonged ventilation requirements, and mortality in patients undergoing liver transplantation. Korean J Anesthesiol 2020; 73: 30-5.