ABSTRACT

Objective: To develop and apply a competency-based test to assess learning among internal medicine residents during a respiratory ICU rotation at a university hospital. Methods: We developed a test comprising 19 multiple-choice questions regarding knowledge of mechanical ventilation (MV) and 4 self-assessment questions regarding the degree of confidence in the management of MV. The test was applied on the first and last day of a 30-day respiratory ICU rotation (pre-rotation and post-rotation, respectively). During the rotation, the residents had lectures, underwent simulator training, and shadowed physicians on daily bedside rounds focused on teaching MV management. Results: Fifty residents completed the test at both time points. The mean score increased from 6.9 ± 1.2 (pre-rotation) to 8.6 ± 0.8 (post-rotation; p < 0.001). On questions regarding the approach to hypoxemia, the recognition of patient-ventilator asynchrony, and the recognition of risk factors for extubation failure, the post-rotation scores were significantly higher than the pre-rotation scores. Confidence in airway management increased from 6% before the rotation to 22% after the rotation (p = 0.02), whereas confidence in making the initial MV settings increased from 31% to 96% (p < 0.001) and confidence in adjusting the ventilator modes increased from 23% to 77% (p < 0.001). Conclusions: We developed a competency-based test to assess knowledge of MV among residents before and after an rotation in a respiratory ICU. Resident performance increased significantly after the rotation, as did their confidence in caring for patients on MV.

Keywords: Education, medical; Respiration, artificial; Surveys and questionnaires; internship and residency; Competency-based education; Educational measurement.

RESUMO

Objetivo: Desenvolver e aplicar um teste baseado em competências para avaliar o aprendizado de residentes de clínica médica em estágio na UTI respiratória de um hospital universitário. Métodos: Desenvolvemos um teste com 19 questões de múltipla escolha sobre conhecimento em ventilação mecânica (VM) e 4 questões de autoavaliação sobre o nível de confiança no manejo da VM. Os testes foram aplicados no primeiro (pré-estágio) e no último dia (pós-estágio) do estágio de 30 dias na UTI respiratória. Durante o estágio, os residentes tiveram aulas teóricas, treinamento com simulador e visitas diárias à beira do leito focadas no ensino de VM. Resultados: Cinquenta residentes completaram o teste nos dois momentos. A média de pontuação (0-10 pontos) aumentou de 6,9 ± 1,2 no pré-estágio para 8,6 ± 0,8 no pós-estágio (p < 0,001). Observamos um aumento significativo no pós-estágio comparado com o pré-estágio em questões sobre abordagem da hipoxemia, reconhecimento da assincronia paciente-ventilador e reconhecimento de fatores de risco para falha de extubação. A confiança na abordagem de vias aéreas aumentou de 6% para 22% ao final do estágio (p = 0,02). A confiança no ajuste inicial da VM subiu de 31% para 96% (p < 0,001), e a confiança no ajuste dos modos ventilatórios aumentou de 23% para 77% (p < 0,001). Conclusões: Desenvolvemos um teste baseado em competências para avaliar o conhecimento sobre VM entre residentes antes e depois de um estágio em UTI respiratória. O desempenho dos residentes ao final do estágio aumentou significativamente, assim como sua confiança para cuidar de pacientes sob VM.

Palavras-chave: Educação médica; Respiração artificial; Inquéritos e questionários; Internato e residência; Educação baseada em competências; Avaliação educacional.

INTRODUCTION

Since the polio epidemic in Copenhagen in 1952,(1-3) mechanical ventilation (MV) has been the key element in the care of patients with respiratory failure(4) and continues to be the most widely used technique for providing life support .(5)

The use of MV is associated with significantly higher daily costs for patients receiving treatment in the ICU. (6) In addition to the costs, the need for MV continues to be associated with high mortality, in Brazil and in other countries, despite scientific advances in the area.(4,7,8)

Strategies that result in shorter ICU stays or less time on MV could lead to substantial reductions in the total cost per inpatient.(9) In addition, the appropriate adjustment of MV settings could reduce mortality in various clinical scenarios.(4,10-13) Therefore, instruction regarding the indications for and management of MV is essential to ensure the appropriate training of residents who will treat critically ill patients. Given that most ICU patients in Brazil and elsewhere are treated by clinicians who are not intensivists,(14-16) an MV curriculum for residents is important not only residency programs in intensive care but also in those in internal medicine.

There are few data in the literature on whether and how residency programs provide appropriate training in the management of MV.(17,18) In a study conducted by Willcox et al.,(19) emergency medicine residents reported that, although they frequently treated patients on MV, they felt that they had not received sufficient instruction on the management of MV. In a study involving medical students, residents, and emergency medicine physicians in Brazil, 85% of the participants believed that they had not received enough information about MV during their medical training and considered themselves underqualified to care for patients on MV.(20) In addition, there is no consensus on how to assess resident knowledge of MV. Although the development of validated assessment tools to measure learning is the most highly recommended method,(21,22) the effective application of such tools still presents a challenge in all areas of medicine.(23)

For an assessment to be considered well-planned, competencies and learning objectives in MV must first be established.(18,24)

In the present study, we developed and applied a test to assess the knowledge and learning of internal medicine residents who completed a supervised rotation at a university hospital respiratory ICU. Our hypothesis was that their knowledge of MV and confidence in managing patients on MV would increase after a 30-day respiratory ICU rotation focused on MV management.

METHODS

Location and participants

This study was carried out in the Respiratory ICU of the Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo (HCFMUSP, University of São Paulo School of Medicine Hospital das Clínicas), located in the city of São Paulo, Brazil, between September of 2014 and August of 2015. The study was approved by the local research ethics committee. Given that it was a project designed to assess resident performance, an activity that is within the scope of the medical residency program, the requirement for informed consent was waived.

The study participants were second-year internal medicine residents at the HCFMUSP. The study inclusion criteria were being an internal medicine resident at the HCFMUSP and being an intern in the HCFMUSP respiratory ICU during the study period. The exclusion criterion was not completing the assessments during the rotation.

Test development

We developed a multiple-choice question test based on clinical cases, initially comprising 22 questions. The questions were developed on the basis of lists of competencies and learning objectives in MV in adult individuals, described in the literature,(18,24) as well as on the basis of our respiratory ICU residency program. Most questions were based on clinical cases, and a given case could be used for multiple questions.

First, the questions were discussed with our senior team, consisting of five MV specialists with more than 10 years of experience in ICUs, all of whom were involved in researching and teaching MV. On the basis of those discussions, 3 questions were excluded because they were not considered highly relevant for assessing knowledge of MV. Therefore, the final version of the test comprised 19 questions. To improve clarity, the group of specialists modified some of those questions, and the consensus opinion was that the final version of the test (Chart S1, supplementary material) was appropriate.

The key knowledge topics addressed on the test were cardiopulmonary physiology, interpretation of waveforms, adjustment of ventilator settings, and ventilator mode recognition (Chart 1). In addition to the questions regarding adjustment of MV, we included 4 self-assessment questions about the degree of confidence in airway management, in applying noninvasive ventilation (NIV), in making the initial MV settings, and in adjusting basic ventilator modes. Those four questions were scored on a Likert scale with 5 possible answers, ranging from 0 (I am not at all confident) to 4 (I am completely confident). The scores were later regrouped into two categories: low confidence (0, 1, and 2); and high confidence (3 and 4).
 



Data collection

The test was administered to residents twice during their rotation in the HCFMUSP respiratory ICU. The rotation lasted 30 days, and the test was administered on the first and last days of that period (pre-rotation and post-rotation, respectively).

During the between-test interval, the residents were responsible for the care of patients on MV, making changes to the ventilator settings with the help of pulmonology residents, pulmonologists, and intensivists, who were responsible for supervising the residents during their ICU rotation. Rotation activities included daily multidisciplinary rounds to discuss cases and plan treatment, with a focus on MV, as well as to provide overall care to the patients. Rounds lasted an average of two hours, with the participation of a supervising physician, all residents, and the ICU respiratory therapist. In addition, the residents participated in bedside discussions that focused on the care of patients on MV, involving ventilator waveform interpretation and ventilator setting adjustments. Those discussions were based on the needs of the resident. Whenever the MV settings were going to be changed in the morning, the supervising physician and the residents gathered at the bedside to discuss the ventilator settings. Throughout the day, depending on the complexity of each case, the settings were reviewed, and the residents had the opportunity to adjust the settings under the supervision of the pulmonology residents or supervising physicians. The residents had four one-hour lectures addressing the following topics: ventilator modes; MV in acute respiratory distress syndrome (ARDS) and severe hypoxemia; MV in patients with obstructive lung disease; and weaning from MV. The lectures combined a traditional expository model, in which ventilator waveforms were drawn on a whiteboard, and a participatory model, in which the residents posed questions and made suggestions. In addition, MV simulations were carried out using online software (xlung Excellence in teaching mechanical ventilation management simulator; Pulmocenter, Fortaleza, Brazil). The practical training with the virtual tool lasted approximately 90 min, and, using standardized clinical cases, the residents were encouraged to suggest adjustments to the virtual ventilator settings and evaluate the result of their decisions. The same supervising physicians were responsible for teaching the residents throughout the study period.

The primary outcome variable was the test score, normalized to vary from 0 to 10. The secondary outcome variables were the degrees of confidence (high or low) for the four key competencies addressed in the self-assessment questions.

Statistical analysis

We tested the primary outcome variable for normality with the Shapiro-Wilk test. We used paired t-tests to compare the pre- and post-rotation total scores, whereas we used McNemar's test to compare the pre- and post-rotation rates of correct answers to each knowledge question and to compare the pre- and post-rotation scores on the questions regarding confidence. The level of significance was set at p < 0.05. We used the R statistical program, version 3.5.1 (The R Foundation for Statistical Computing, Vienna, Austria).

RESULTS

During the study period, 59 residents completed an rotation at the HCFMUSP respiratory ICU, and 50 of those residents completed the test at both time points. The mean score increased from 6.9 ± 1.2 (pre-rotation) to 8.6 ± 0.8 (post-rotation; p < 0.001), with a mean pre-rotation to post-rotation difference of 1.67 (95% CI: 1.3-2.0; Figure 1).
 



Table 1 shows the proportion of individuals who answered each question correctly at each of the two time points, and Table S1 (supplementary material) describes the knowledge topic assessed by each question and its correspondence with a list of competencies described in the literature.(18,24) The questions with the highest pre-rotation rates of correct answers were those assessing knowledge of how to calculate respiratory system compliance and resistance, of the characteristics of the basic MV modes, of protective ventilation in ARDS, and of permissive hypercapnia. In contrast, the questions regarding the recognition of asynchrony and of risk factors for extubation failure had the lowest pre-rotation rates of correct answers.
 



We found that the post-rotation rates of correct answers to questions regarding the treatment of hypoxemia, the recognition of patient-ventilator asynchrony, the risks of high inspiratory pressures, and the recognition of risk factors for extubation failure were significantly higher than the pre-rotation ones. The pre-rotation and post-rotation rates of correct answers were both low for only one question, which addressed particularities in the ventilatory management of patients with COPD (Table 1).

The questions regarding the degree of confidence in managing MV after the rotation were answered by 48 residents. Comparing the pre- and post-rotation scores on those questions (Figure 2), we found that the degree of confidence increased from 6% to 22% for airway management (p = 0.02), from 96% to 100% for applying NIV (p = 0.47), from 31% to 96% for making the initial MV settings (p < 0.001), and from 23% to 77% for adjusting the ventilator modes increased (p < 0.001).
 



DISCUSSION

In the present study, we found that the overall performance of second-year internal medicine residents on a clinical case-based test assessing knowledge of MV was moderately good; however, their performance on questions assessing knowledge related to core competencies, such as the recognition of asynchrony and of risk factors for extubation failure, was poor. After a 30-day rotation in a respiratory ICU, their overall performance was significantly higher on most questions. Resident confidence in caring for patients on MV, which was low at the beginning of the rotation, increased significantly as a result of the training.

Although MV management is considered an important skill for residents of various specialties,(17) studies have shown that physicians and other health professionals who work in ICUs have difficulty in interpreting ventilator waveforms,(25) show poor adherence to protective MV protocols in patients with ARDS(12,26) and feel poorly prepared to care for patients on MV.(20) This is probably due, in part, to the fact that instruction in MV is not well standardized, because there is no widely used list of competencies in MV, nor is there consensus on how to develop a specific curriculum in MV and to quantify learning.(18,24,27-29)

In the present study, the pre-rotation total score was moderately high, reflecting the knowledge of MV that was acquired during the ICU rotations in the first year of the residency program. However, the increase in the mean total score after the rotation shows a significant gain of knowledge after the training focused on MV management, a gain that was also observed in a study involving residents who underwent intensive training in MV.(27)

We found that the rate of correct answers to the question assessing protective ventilation in patients with ARDS increased from 94% (pre-rotation) to 100% (post-rotation), a rate that is higher than the 52% reported by Cox et al.(17) in another study involving medical residents. That difference might be due to the fact that protective ventilation has come to be more widely used in recent years and that the study by Cox et al.(17) was published more than a decade ago. With regard to managing NIV, we found rates of correct answers of 76% (pre-rotation) and 98% (post-rotation), compared with 73% in the Cox et al. study.(17) With regard to adjusting ventilator settings to correct auto-positive end-expiratory pressure, the rate of correct answers in the Cox et al. study(17) was 65%, whereas we found rates of 84% (pre-rotation) and 96% (post-rotation).

The rate of correct answers to some questions was low before the rotation but improved significantly after the rotation. That could be attributed to the training and discussions that took place during the rotation, corroborating findings from similar studies.(27) The high rate of correct answers to some questions before the rotation may be related to knowledge of MV gained during previous rotations or to the varying degree of difficulty of the questions.

We found that resident confidence in managing MV before the rotation varied depending on the question. The residents reported a high degree of confidence only in applying NIV, and that remained unaltered after the rotation. That finding differs from one reported by Tallo et al.,(20) who found that only 23% of the participants in their study felt confident enough to initiate NIV. However, in comparison with ours, the sample evaluated in that study(20) was more heterogeneous, including final-year medical students and emergency physicians, which may have contributed to the difference relative to our finding.

The participants in our study had low confidence in airway management, in making the initial MV settings, and in adjusting ventilator modes before the rotation, corroborating previous findings.(20) Their confidence increased significantly for those three skills but remained relatively low for airway management. Although airway management in an emergency setting was not a learning objective of the rotation, the low degree of resident confidence even after the rotation indicates the need for additional training in this area.

Our study has some limitations that should be taken into account when interpreting our results. First, this was a single-center study. Therefore, performance on the test may be associated with the prior knowledge level of the residents selected for admission to our residency program; with specific training, provided in our residency program, in rotations in emergency rooms and ICUs; and with the particularities of the rotation in our respiratory ICU. Second, the test was developed only by professionals in our department, which again may represent the specific view of our residency program. Third, education experts have conflicting opinions on multiple choice tests to measure learning and many now consider the use of simulations to be a more appropriate means of assessment.(29-31) Finally, there is no list of validated and widely accepted MV competencies. Nevertheless, our study has some strengths. We conducted an objective assessment based on clinical cases with scenarios similar to those that residents are exposed to in ICUs in real life. In addition, when we developed the questions, we took into consideration the pre-defined learning objectives in our residency program and in the literature.(24) Furthermore, this was the first study to assess knowledge of MV in a low- or middle-income country.

In terms of future directions, it is essential for residency programs that train physicians who will work in ICUs to have a well-structured MV curriculum based on well-defined learning objectives and competencies, including diversified teaching strategies that combine theoretical classes, discussions, simulations, and bedside teaching.(27,28,31,32) The validation of a list of competencies in MV that can be adopted by various medical residency programs would also be quite useful to ensure that the training provided to residents is appropriate.(24) Finally, the development of tools that are more effective in assessing competency in MV, not only in terms of knowledge, but also in terms of skills and attitudes, such as tools based on simulations or structured objective assessments, would further contribute to improving residency programs so that the training given to physicians working in ICUs in Brazil is appropriate for the care of critically ill patients on MV, which could result in reduced mortality and reduced ICU costs.

In conclusion, we have developed a test, based on lists of competencies in MV, that made it possible to assess the knowledge and learning of second-year internal medicine residents before and after a 30-day rotation in a respiratory ICU, as well as to determine their degree of confidence in the management of MV. At the beginning of the rotation, resident performance on some core topics was insufficient and their confidence in their skills related to the application of MV was low. After the rotation, the performance of the residents improved significantly, as did their confidence in caring for patients on MV.

REFERENCES

1. Kelly FE, Fong K, Hirsch N, Nolan JP. Intensive care medicine is 60 years old: the history and future of the intensive care unit. Clin Med (Lond). 2014;14(4):376-379. https://doi.org/10.7861/clinmedicine.14-4-376
2. Tomicic V, Espinoza M, Andresen M, Molina J, Calvo M, Ugarte H, et al. Characteristics and factors associated with mortality in patients receiving mechanical ventilation: first Chilean multicenter study [Article in Spanish]. Rev Med Chil. 2008;136(8):959-967. https://doi.org/10.4067/S0034-98872008000800001
3. LASSEN HC. A preliminary report on the 1952 epidemic of poliomyelitis in Copenhagen with special reference to the treatment of acute respiratory insufficiency. Lancet. 1953;1(6749):37-41. https://doi.org/10.1016/S0140-6736(53)92530-6
4. Esteban A, Frutos-Vivar F, Muriel A, Ferguson ND, Peñuelas O, Abraira V, et al. Evolution of mortality over time in patients receiving mechanical ventilation. Am J Respir Crit Care Med. 2013;188(2):220-230. https://doi.org/10.1164/rccm.201212-2169OC
5. Pham T, Brochard LJ, Slutsky AS. Mechanical Ventilation: State of the Art. Mayo Clin Proc. 2017;92(9):1382-1400. https://doi.org/10.1016/j.mayocp.2017.05.004
6. Wunsch H, Linde-Zwirble WT, Angus DC, Hartman ME, Milbrandt EB, Kahn JM. The epidemiology of mechanical ventilation use in the United States. Crit Care Med. 2010;38(10):1947-1953. https://doi.org/10.1097/CCM.0b013e3181ef4460
7. Fialkow L, Farenzena M, Wawrzeniak I, Brauner JS, Vieira SR, Vigo A, et al. Mechanical ventilation in patients in the intensive care unit of a general university hospital in southern Brazil: an epidemiological study. Clinics (Sao Paulo). 2016;71(3):144-151. https://doi.org/10.6061/clinics/2016(03)05
8. Azevedo LC, Park M, Salluh JI, Rea-Neto A, Souza-Dantas VC, Varaschin P, et al. Clinical outcomes of patients requiring ventilatory support in Brazilian intensive care units: a multicenter, prospective, cohort study. Crit Care. 2013;17(2):R63. https://doi.org/10.1186/cc12594
9. Dasta JF, McLaughlin TP, Mody SH, Piech CT. Daily cost of an intensive care unit day: the contribution of mechanical ventilation. Crit Care Med. 2005;33(6):1266-1271. https://doi.org/10.1097/01.CCM.0000164543.14619.00
10. Amato MB, Meade MO, Slutsky AS, Brochard L, Costa EL, Schoenfeld DA, et al. Driving pressure and survival in the acute respiratory distress syndrome. N Engl J Med. 2015;372(8):747-755. https://doi.org/10.1056/NEJMsa1410639
11. Acute Respiratory Distress Syndrome Network, Brower RG, Matthay MA, Morris A, Schoenfeld D, Thompson BT, et al. Ventilation with lower tidal volumes as compared with traditional tidal volumes for acute lung injury and the acute respiratory distress syndrome. N Engl J Med. 2000;342(18):1301-1308. https://doi.org/10.1056/NEJM200005043421801
12. Weiss H, Baker DW, Weiner S, Bechel M, Ragland M, Rademaker A, et al. Low Tidal Volume Ventilation Use in Acute Respiratory Distress Syndrome. Crit Care Med. 2016;44(8):1515-1522. https://doi.org/10.1097/CCM.0000000000001710
13. Bellani G, Laffey JG, Pham T, Fan E, Brochard L, Esteban A, et al. Epidemiology, Patterns of Care, and Mortality for Patients With Acute Respiratory Distress Syndrome in Intensive Care Units in 50 Countries [published correction appears in JAMA. 2016 Jul 19;316(3):350] [published correction appears in JAMA. 2016 Jul 19;316(3):350]. JAMA. 2016;315(8):788-800. https://doi.org/10.1001/jama.2016.0291
14. Hassegawa LCU, Escobar AL, Silva LRG, Katsuragawa TH. he Profile of Medical Education on Intensive Care in the State of Rondônia, Brazil [Article in Portuguese]. Rev Bras Educ Med. 2017;41(1):38-43. https://doi.org/10.1590/1981-52712015v41n1rb20160011
15. Piquette D, Fowler RA, Slutsky AS. Impact of intensivist staffing on patient care and trainee education: a Canadian perspective. Am J Respir Crit Care Med. 2010;182(4):442-444. https://doi.org/10.1164/rccm.201006-0973ED
16. Pastores SM, Kevtan V. Shortage of intensive care specialists in the United States: recent insights and proposed solutions. Rev Bras Ter Intensiva. 2015;27(1):5-6. https://doi.org/10.5935/0103-507X.20150002
17. Cox CE, Carson SS, Ely EW, Govert JA, Garrett JM, Brower RG, et al. Effectiveness of medical resident education in mechanical ventilation. Am J Respir Crit Care Med. 2003;167(1):32-38. https://doi.org/10.1164/rccm.200206-624OC
18. O'Boyle AL, Mink RB, Anas NG, Kallay TC. Development of learning objectives and a validated testing tool for management of pediatric mechanical ventilation*. Pediatr Crit Care Med. 2014;15(7):594-599. https://doi.org/10.1097/PCC.0000000000000195
19. Wilcox SR, Strout TD, Schneider JI, Mitchell PM, Smith J, Lutfy-Clayton L, et al. Academic Emergency Medicine Physicians' Knowledge of Mechanical Ventilation. West J Emerg Med. 2016;17(3):271-279. https://doi.org/10.5811/westjem.2016.2.29517
20. Tallo FS, de Campos Vieira Abib S, de Andrade Negri AJ, Cesar P Filho, Lopes RD, Lopes AC. Evaluation of self-perception of mechanical ventilation knowledge among Brazilian final-year medical students, residents and emergency physicians. Clinics (Sao Paulo). 2017;72(2):65-70. https://doi.org/10.6061/clinics/2017(02)01
21. Holmboe ES, Hawkins RE, Durning SJ. Practical Guide to the Evaluation of Clinical Competence, 1st ed. Philadelphia: Mosby Elsevier; 2008.
22. Tibério IF, Daud-Gallotti, RM, Troncon LE, Martins MA. Avaliação Prática de Habilidades Clínicas em Medicina. São Paulo: Atheneu; 2012.
23. Carraccio C, Wolfsthal SD, Englander R, Ferentz K, Martin C. Shifting paradigms: from Flexner to competencies. Acad Med. 2002;77(5):361-367. https://doi.org/10.1097/00001888-200205000-00003
24. Goligher EC, Ferguson ND, Kenny LP. Core competency in mechanical ventilation: development of educational objectives using the Delphi technique. Crit Care Med. 2012;40(10):2828-2832. https://doi.org/10.1097/CCM.0b013e31825bc695
25. Colombo D, Cammarota G, Alemani M, Carenzo L, Barra FL, Vaschetto R, et al. Efficacy of ventilator waveforms observation in detecting patient-ventilator asynchrony. Crit Care Med. 2011;39(11):2452-2457. https://doi.org/10.1097/CCM.0b013e318225753c
26. Spece LJ, Mitchell KH, Caldwell ES, Gundel SJ, Jolley SE, Hough CL. Low tidal volume ventilation use remains low in patients with acute respiratory distress syndrome at a single center. J Crit Care. 2018;44:72-76. https://doi.org/10.1016/j.jcrc.2017.10.021
27. Yee J, Fuenning C, George R, Hejal R, Haines N, Dunn D, et al. Mechanical Ventilation Boot Camp: A Simulation-Based Pilot Study. Crit Care Res Pract. 2016;2016:4670672. https://doi.org/10.1155/2016/4670672
28. Spadaro S, Karbing DS, Fogagnolo A, Ragazzi R, Mojoli F, Astolfi L, et al. Simulation Training for Residents Focused on Mechanical Ventilation: A Randomized Trial Using Mannequin-Based Versus Computer-Based Simulation. Simul Healthc. 2017;12(6):349-355. https://doi.org/10.1097/SIH.0000000000000249
29. Rogers PL, Jacob H, Rashwan AS, Pinsky MR. Quantifying learning in medical students during a critical care medicine elective: a comparison of three evaluation instruments. Crit Care Med. 2001;29(6):1268-1273. https://doi.org/10.1097/00003246-200106000-00039
30. Lino JA, Gomes GC, Sousa ND, Carvalho AK, Diniz ME, Viana Junior AB, et al. A Critical Review of Mechanical Ventilation Virtual Simulators: Is It Time to Use Them?. JMIR Med Educ. 2016;2(1):e8. https://doi.org/10.2196/mededu.5350
31. Schroedl CJ, Corbridge TC, Cohen ER, Fakhran SS, Schimmel D, McGaghie WC, et al. Use of simulation-based education to improve resident learning and patient care in the medical intensive care unit: a randomized trial. J Crit Care. 2012;27(2):. https://doi.org/10.1016/j.jcrc.2011.08.006
32. Santhosh L, Brown W, Ferreira J, Niroula A, Carlos WG. Practical Tips for ICU Bedside Teaching. Chest. 2018;154(4):760-765. https://doi.org/10.1016/j.chest.2018.06.034