From concepts to evaluation: mapping approaches to POCUS training assessment in low- and middle-income countries – a systematic scoping review
Keywords:
Point of Care Ultrasound, POCUS, Training, training evaluation, medical educationAbstract
Background:
Point-of-care ultrasound (POCUS) training programs are increasingly implemented in low- and middle-income countries (LMICs) to strengthen diagnostic capacity. Qualitative and sustainable implementation of POCUS capacity requires evaluation of training concepts and programs. In this review we collate approaches of how POCUS training programs and trainee competencies are evaluated in LMICs.
Methods:
This review presents a secondary analysis of data from a previous systematic scoping review that included 53 original studies on POCUS training in LMICs, identified through July 2023. Reported evaluation methods for POCUS training were extracted and categorized according to the Donabedian (structure, process, outcomes) and Miller/De Biasio (levels of competence) frameworks. Data synthesis focused on the type, timing, and scope of evaluation across structural, procedural, and outcome domains.
Results:
POCUS training evaluation approaches were highly heterogeneous, with most studies using multiple methods. Pre- and post-course assessments predominated, focusing mainly on knowledge and technical skills. Competence evaluations covered all levels of the Miller/De Biasio framework, though most targeted lower-order levels, while workplace-based assessments were infrequent. When mapped to Donabedian’s model, outcome evaluations dominated, whereas structural and process assessments were inconsistently reported. Few studies demonstrated contextual adaptation, validity testing, or long-term evaluation of training outcomes.
Conclusions:
POCUS training evaluation in LMICs remains inconsistent and focuses primarily on short-term outcomes and basic competency levels. Applying Donabedian’s and Miller/De Biasio’s frameworks reveals critical evaluation deficiencies across system and learner dimensions and establishes a conceptional basis for more comprehensive and sustainable POCUS evaluation strategies.
References
1. Groen RS, Leow JJ, Sadasivam V, Kushner AL. Review: indications for ultrasound use in low- and middle-income countries. Trop Med Int Health. 2011;16(12):1525-35.
2. Belard S, Tamarozzi F, Bustinduy AL, Wallrauch C, Grobusch MP, Kuhn W, et al. Point-of-Care Ultrasound Assessment of Tropical Infectious Diseases--A Review of Applications and Perspectives. Am J Trop Med Hyg. 2016;94(1):8-21.
3. Huson MAM, Kaminstein D, Kahn D, Belard S, Ganesh P, Kandoole-Kabwere V, et al. Cardiac ultrasound in resource-limited settings (CURLS): towards a wider use of basic echo applications in Africa. Ultrasound J. 2019;11(1):34.
4. Remppis J, Verheyden A, Bustinduy AL, Heller T, Garcia-Tardon N, Manouana GP, et al. Focused Assessment with Sonography for Urinary Schistosomiasis (FASUS)-pilot evaluation of a simple point-of-care ultrasound protocol and short training program for detecting urinary tract morbidity in highly endemic settings. Trans R Soc Trop Med Hyg. 2020;114(1):38-48.
5. Kaminstein D, Heller T, Tamarozzi F. Sound Around the World: Ultrasound for Tropical Diseases. Infect Dis Clin North Am. 2019;33(1):169-95.
6. Abrokwa SK, Ruby LC, Heuvelings CC, Belard S. Task shifting for point of care ultrasound in primary healthcare in low- and middle-income countries-a systematic review. EClinicalMedicine. 2022;45:101333.
7. Heller T, Wallrauch C, Goblirsch S, Brunetti E. Focused assessment with sonography for HIV-associated tuberculosis (FASH): a short protocol and a pictorial review. Crit Ultrasound J. 2012;4(1):21.
8. Fleming KA, Horton S, Wilson ML, Atun R, DeStigter K, Flanigan J, et al. The Lancet Commission on diagnostics: transforming access to diagnostics. The Lancet. 2021;398(10315):1997-2050.
9. Frija G, Blažić I, Frush DP, Hierath M, Kawooya M, Donoso-Bach L, et al. How to improve access to medical imaging in low- and middle-income countries ? eClinicalMedicine. 2021;38:101034.
10. Yadav H, Shah D, Sayed S, Horton S, Schroeder LF. Availability of essential diagnostics in ten low-income and middle-income countries: results from national health facility surveys. The Lancet Global Health. 2021;9(11):e1553-e60.
11. Kawooya MG. Training for Rural Radiology and Imaging in Sub-Saharan Africa: Addressing the Mismatch Between Services and Population. Clinical Imaging Science. 2012;2(2):37.
12. Henwood P, DC M, JS R, AF M, MM L, AJ D, et al. A practical guide to self-sustaining point-of-care ultrasound education programs in resource-limited settings. Annals of emergency medicine. 2014;64(3):277-85.e2.
13. Eppel F, Hunstig F, Bélard S, Kreuels B. Concepts for point-of-care ultrasound training in low resource settings: a scoping review. The Ultrasound Journal. 2025;17(1):24.
14. Attree M. Evaluating healthcare education: Issues and methods. Nurse Education Today. 2006;26(8):640-6.
15. Miller GE. The assessment of clinical skills/competence/performance. Acad Med. 1990;65(9 Suppl):S63-7.
16. Moore DEJ, Green JS, Gallis HA. Achieving desired results and improved outcomes: Integrating planning and assessment throughout learning activities. Journal of Continuing Education in the Health Professions. 2009;29(1):1-15.
17. Kirkpatrick D, Kirkpatrick J. Evaluating training programs: The four levels: Berrett-Koehler Publishers; 2006.
18. Kirkpatrick D. Great ideas revisited. Training & Development. 1996;50(1):54-60.
19. Donabedian A. The Quality of Care: How Can It Be Assessed? JAMA. 1988;260(12):1743-8.
20. Donabedian A. Evaluating physician competence. Bull World Health Organ. 2000;78(6):857-60.
21. Donabedian A. Evaluating the Quality of Medical Care. The Milbank Memorial Fund Quarterly. 1966;44(3):166-206.
22. Gullick J, Lin F, Massey D, Wilson L, Greenwood M, Skylas K, et al. Structures, processes and outcomes of specialist critical care nurse education: An integrative review. Aust Crit Care. 2019;32(4):331-45.
23. DeBiasio C, Pageau P, Shefrin A, Woo MY, Cheung WJ. Point-of-Care-ultrasound in undergraduate medical education: a scoping review of assessment methods. Ultrasound J. 2023;15(1):30.
24. Tolsgaard MG, Todsen T, Sorensen JL, Ringsted C, Lorentzen T, Ottesen B, et al. International multispecialty consensus on how to evaluate ultrasound competence: a Delphi consensus survey. PLoS One. 2013;8(2):e57687.
25. Gottlieb M, Duanmu Y. Beyond the Numbers: Assessing Competency in Point-of-Care Ultrasound. Annals of Emergency Medicine. 2023;81(4):427-8.
26. Damewood SC, Leo M, Bailitz J, Gottlieb M, Liu R, Hoffmann B, et al. Tools for Measuring Clinical Ultrasound Competency: Recommendations From the Ultrasound Competency Work Group. AEM Educ Train. 2020;4(Suppl 1):S106-s12.
27. Bell C, Hall AK, Wagner N, Rang L, Newbigging J, McKaigney C. The Ultrasound Competency Assessment Tool (UCAT): Development and Evaluation of a Novel Competency-based Assessment Tool for Point-of-care Ultrasound. AEM Educ Train. 2021;5(3):e10520.
28. Kumar A, Kugler J, Jensen T. Evaluation of Trainee Competency with Point-of-Care Ultrasonography (POCUS): a Conceptual Framework and Review of Existing Assessments. Journal of General Internal Medicine. 2019;34(6):1025-31.
29. Boniface KS, Ogle K, Aalam A, LeSaux M, Pyle M, Mandoorah S, et al. Direct Observation Assessment of Ultrasound Competency Using a Mobile Standardized Direct Observation Tool Application With Comparison to Asynchronous Quality Assurance Evaluation. AEM Educ Train. 2019;3(2):172-8.
30. Ma IWY, Desy J, Woo MY, Kirkpatrick AW, Noble VE. Consensus-Based Expert Development of Critical Items for Direct Observation of Point-of-Care Ultrasound Skills. J Grad Med Educ. 2020;12(2):176-84.
31. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Annals of Internal Medicine. 2018;169(7):467-73.
32. Peters MDJ. Chapter 11: Scoping Reviews (2020 version). In: Aromataris E, Munn Z, editors. JBI Manual for Evidence Synthesis: JBI; 2020. p. 407-51.
33. Peters MDJ, Marnie C, Tricco AC, Pollock D, Munn Z, Alexander L, et al. Updated methodological guidance for the conduct of scoping reviews. JBI Evid Synth. 2020;18(10):2119-26.
34. WorldBank. World Bank Country and Lending Groups. Country Classification.: The World Bank Group 2022 [Available from: https://datahelpdesk.worldbank.org/knowledgebase/articles/906519-world-bank-country-and-lending-groups.
35. Moola S, Munn Z, Tufanaru C, Aromataris E, Sears K, Sfetcu R, et al. Chapter 7: Systematic reviews of etiology and risk. In: Aromataris E, Munn Z, editors. JBI Manual for Evidency Synthesis: JBI; 2020.
36. Downs SH, Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Community Health. 1998;52(6):377-84.
37. Dreyfuss A, Martin D, Farro A, Inga R, Enríquez S, Mantuani D, et al. A Novel Multimodal Approach to Point-of-Care Ultrasound Education in Low-Resource Settings. The western journal of emergency medicine. 2020;21(4):1017-21.
38. Nadimpalli A, Tsung J, Sanchez R, Shah S, Zelikova E, Umphrey L, et al. Feasibility of Training Clinical Officers in Point-of-Care Ultrasound for Pediatric Respiratory Diseases in Aweil, South Sudan. The American journal of tropical medicine and hygiene. 2019;101(3):689-95.
39. Vanichkulbodee A, Inboriboon P, Balk A, Sri-On J. Perception of an Introductory Point-of-Care Ultrasound Course for Thai Medical Students on Emergency Medicine Rotation. Open access emergency medicine : OAEM. 2021;13:291-8.
40. Rominger A, Gomez G, Elliott P. The implementation of a longitudinal POCUS curriculum for physicians working at rural outpatient clinics in Chiapas, Mexico. Critical ultrasound journal. 2018;10(1):19.
41. Aspler A, Kegel F, Beyene T, Zewdu T, Tesfaye B, McKnight A, et al. Establishing a Self-sustaining Emergency Medicine Point-of-Care Ultrasound Curriculum in an Academic Teaching Hospital in Ethiopia. Ethiopian journal of health sciences. 2022;32(3):533-8.
42. Terry B, Polan D, Nambaziira R, Mugisha J, Bisanzo M, Gaspari R. Rapid, remote education for point-of-care ultrasound among non-physician emergency care providers in a resource limited setting. African journal of emergency medicine : Revue africaine de la medecine d'urgence. 2019;9(3):140-4.
43. Barsky M, Kushner L, Ansbro M, Bowman K, Sassounian M, Gustafson K, et al. A feasibility study to determine if minimally trained medical students can identify markers of chronic parasitic infection using bedside ultrasound in rural Tanzania. World Journal of Emergency Medicine. 2015;6(4):293-8.
44. Bell G, Wachira B, Denning G. A pilot training program for point-of-care ultrasound in Kenya. African Journal of Emergency Medicine. 2016;6(3):132-7.
45. Bentley S, Hexom B, Nelson BP. Evaluation of an Obstetric Ultrasound Curriculum for Midwives in Liberia. Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine. 2015;34(9):1563-8.
46. Bhoi S, Sinha TP, Ramch, ani R, Kurrey L, Galwankar S. To determine the accuracy of focused assessment with sonography for trauma done by nonradiologists and its comparative analysis with radiologists in emergency department of a level 1 trauma center of India. Journal of Emergencies, Trauma and Shock. 2013;6(1):42-6.
47. Damgengkajornwong P, Kotruchin P, Ianghong K, Pongchaiyakul C. The focused cardiac ultrasound skill of newly-graduated Thai doctors. Journal of the Medical Association of Thailand. 2018;101(7):S113-S8.
48. House D, Amatya Y, Nti B, Russell F. Lung ultrasound training and evaluation for proficiency among physicians in a low-resource setting. The ultrasound journal. 2021;13(1):34.
49. Nazari E, Tajani ZB, Maroufizadeh S, Ghorbaniid M, Rad AH, Badeli H. The effect of short-course point-of-care echocardiography training on the performance of medical interns in children. PLoS ONE. 2022;17(12):e0278173.
50. Hall E, Matilsky D, Zang R, Hase N, Habibu Ali A, Henwood P, et al. Analysis of an obstetrics point-of-care ultrasound training program for healthcare practitioners in Zanzibar, Tanzania. The ultrasound journal. 2021;13(1):18.
51. Vanderburg S, Kodikara I, Tharakan A, Sheng T, Gallis JA, Sellathurai M, et al. A Practical Approach to Lung Ultrasound Training in Sri Lanka. ATS Scholar. 2023:ats-scholar. 2022-0072BR.
52. Wanjiku G, Dreizler L, Bell G, Wachira B. Feasibility of project ECHO telementoring to build capacity among non-specialist emergency care providers. African journal of emergency medicine : Revue africaine de la medecine d'urgence. 2022;12(4):352-7.
53. Wanjiku G, Bell G, Wachira B. Assessing a novel point-of-care ultrasound training program for rural healthcare providers in Kenya. BMC health services research. 2018;18(1):607.
54. Shokoohi H, Raymond A, Fleming K, Scott J, Kerry V, Haile-Mariam T, et al. Assessment of Point-of-Care Ultrasound Training for Clinical Educators in Malawi, Tanzania and Uganda. Ultrasound in medicine & biology. 2019;45(6):1351-7.
55. Haldeman MS, Kunka E, Makasa M, Birkl, B. Resident perception on the impact of point-of-care ultrasound in clinical care at a family medicine training program in Zambia. Ultrasound Journal. 2022;14(1):18.
56. Kimberly H, Murray A, Mennicke M, Liteplo A, Lew J, Bohan J, et al. Focused maternal ultrasound by midwives in rural Zambia. Ultrasound in medicine & biology. 2010;36(8):1267-72.
57. Ienghong K, Apiratwarakul K. One year of experience in using hand-held ultrasound as a learning tool in ultrasound rotation at the emergency department. Open Access Macedonian Journal of Medical Sciences. 2020;8:674-7.
58. Ienghong K, Apiratwarakul K, Tiamkao S, Bhudhisawasdi V. Development and remodeling of point-of-care ultrasound education for emergency medicine residents in resource-limited countries during the COVID-19 pandemic. Hong Kong Journal of Emergency Medicine. 2022;29(1):34S.
59. Ienghong K, Suzuki T, Phengsavanh A, Nasaarn T. Competency of ultrasound knowledge of Laos emergency medicine residents during international elective rotation in Thailand. Journal of the Medical Association of Thailand. 2021;104(2):S20-S4.
60. Ienghong K, Suzuki T, Tiamkao S, Bhudhisawasdi V, Gaysonsiri D, Apiratwarakul K. Point of care ultrasound training during the coronavirus disease 2019 pandemic. Open Access Macedonian Journal of Medical Sciences. 2021;9:443-6.
61. Schmidt J, Chiu A, Okiror W, Kolkowitz I, Svenson J, Olupot-Olupot P. Training for Pediatric Cardiac and Pulmonary Point of Care Ultrasound in Eastern Uganda. Ultrasound in medicine & biology. 2022;48(12):2461-7.
62. Lee J, Tse C, Keown T, Louthan M, Gabriel C, Anshus A, et al. Evaluation of a point of care ultrasound curriculum for Indonesian physicians taught by first-year medical students. World journal of emergency medicine. 2017;8(4):281-6.
63. Jones L, Gathu C, Szkwarko D, Mucheru S, Amin N, Amisi JA, et al. Expanding Point-of-Care Ultrasound Training in a Low- and Middle-Income Country: Experiences From a Collaborative Short-Training Workshop in Kenya. Family medicine. 2020;52(1):38-42.
64. Silva J, Plescia T, Molina N, Tonelli A, Langdorf M, Fox J. Randomized study of effectiveness of computerized ultrasound simulators for an introductory course for residents in Brazil. Journal of educational evaluation for health professions. 2016;13:16.
65. Shumbusho J, Duanmu Y, Kim S, Bassett I, Boyer E, Ruutiainen A, et al. Accuracy of Resident-Performed Point-of-Care Lung Ultrasound Examinations Versus Chest Radiography in Pneumothorax Follow-up After Tube Thoracostomy in Rwanda. England2020 2020-3. 499-506 p.
66. Azizi K, Ismail M, Aftab U, Afzal B, Mian A. Effectiveness of High-Fidelity Simulation in Training Emergency Medicine Physicians in Point of Care Ultrasonography in Pakistan: A Quasi-Experimental Study. Cureus. 2020;12(6):e8659.
67. Dornhofer K, Farhat A, Guan K, Parker E, Kong C, Kim D, et al. Evaluation of a point-of-care ultrasound curriculum taught by medical students for physicians, nurses, and midwives in rural Indonesia. Journal of clinical ultrasound : JCU. 2020;48(3):145-51.
68. Kimambo D, Kennedy S, Kifai E, Kailembo N, Eichberg C, Markosky S, et al. Feasibility of point-of-care cardiac ultrasound performed by clinicians at health centers in Tanzania. BMC Cardiovascular Disorders. 2021;21(1):239.
69. Kolbe N, Killu K, Coba V, Neri L, Garcia KM, McCulloch M, et al. Point of care ultrasound (POCUS) telemedicine project in rural Nicaragua and its impact on patient management. Journal of Ultrasound. 2015;18(2):179-85.
70. Boniface K, Raymond A, Fleming K, Scott J, Kerry V, Haile-Mariam T, et al. The Global Health Service Partnership's point-of-care ultrasound initiatives in Malawi, Tanzania and Uganda. United States2019 2019-4. 777-9 p.
71. Dreizler L, Wanjiku G. Tele-ECHO for Point-of-Care Ultrasound in Rural Kenya: A Feasibility Study. Rhode Island medical journal (2013). 2019;102(7):28-31.
72. Stolz L, Muruganandan K, Bisanzo M, Sebikali M, Dreifuss B, Hammerstedt H, et al. Point-of-care ultrasound education for non-physician clinicians in a resource-limited emergency department. Tropical medicine & international health : TM & IH. 2015;20(8):1067-72.
73. Gómez Betancourt M, Moreno-Montoya J, Barragán González A, Ovalle J, Bustos Martínez Y. Learning process and improvement of point-of-care ultrasound technique for subxiphoid visualization of the inferior vena cava. Critical ultrasound journal. 2016;8(1):4.
74. Osei-Ampofo M, Tafoya M, Tafoya C, Oteng R, Ali H, Becker T. Skill and knowledge retention after training in cardiopulmonary ultrasound in Ghana: an impact assessment of bedside ultrasound training in a resource-limited setting. Emergency medicine journal : EMJ. 2018;35(11):704-7.
75. Shaffer M, Brown H, McCoy C, Bashaka P. Evaluation of a Short-term Training Program in Bedside Emergency Ultrasound in Southwestern Tanzania. Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine. 2017;36(3):515-21.
76. Bui M, Fernandez A, Ramsukh B, Noel O, Prashad C, Bayne D. Training and implementation of handheld ultrasound technology at Georgetown Public Hospital Corporation in Guyana: a virtual learning cohort study. Journal of educational evaluation for health professions. 2023;20:11.
77. Marihan A, Sophia S, Louis P, Megan V, Tina H. Evaluation of Ultrasound Teaching Curriculum in Tanzania by First Year Medical Students: A Comparison of Language on Learning Outcomes. Curr Res Emerg Med. 2021;1:1004.
78. Matiang'i M, Ngunju P, Koen J, Kiilu C, Romy H, Hetyey A, et al. Viability of Point of Care Ultrasound screening in Primary Health Care Setting: A Kenyan Experience. 2022.
79. Henwood P, Mackenzie D, Liteplo A, Rempell J, Murray A, Leo M, et al. Point-of-Care Ultrasound Use, Accuracy, and Impact on Clinical Decision Making in Rwanda Hospitals. Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine. 2017;36(6):1189-94.
80. Henwood P, Mackenzie D, Rempell J, Douglass E, Dukundane D, Liteplo A, et al. Intensive point-of-care ultrasound training with long-term follow-up in a cohort of Rwandan physicians. Tropical medicine & international health : TM & IH. 2016;21(12):1531-8.
81. Vinayak S, Sande J, Nisenbaum H, Nolsøe C. Training Midwives to Perform Basic Obstetric Point-of-Care Ultrasound in Rural Areas Using a Tablet Platform and Mobile Phone Transmission Technology-A WFUMB COE Project. Ultrasound in medicine & biology. 2017;43(10):2125-32.
82. Vinayak S, Brownie S. Collaborative task-sharing to enhance the Point-Of-Care Ultrasound (POCUS) access among expectant women in Kenya: The role of midwife sonographers. Journal of interprofessional care. 2018;32(5):641-4.
83. Shah S, Santos N, Kisa R, Maxwell OM, Mulowooza J, Walker D, et al. Efficacy of an ultrasound training program for nurse midwives to assess high-risk conditions at labor triage in rural Uganda. PLoS ONE. 2020;15(6):e0235269.
84. Shrestha R, Blank W, Shrestha AP, Pradhan A. Evaluation of interdisciplinary emergency ultrasound workshop for primary care physicians in Nepal. Open Access Emergency Medicine. 2020;12:99-109.
85. Denny S, Minteer W, Fenning R, Aggarwal S, Lee D, Raja S, et al. Ultrasound curriculum taught by first-year medical students: A four-year experience in Tanzania. World journal of emergency medicine. 2018;9(1):33-40.
86. Reynolds T, Noble J, Paschal G, Sawe H, Sohoni A, Shah S, et al. Bedside ultrasound training at Muhimbili National Hospital in Dar es Salaam, Tanzania and Hospital San Carlos in Chiapas, Mexico. African journal of emergency medicine : Revue africaine de la medecine d'urgence. 2016;6(3):125-31.
87. Tafoya CA, Tafoya MJ, Osei-Ampofo M, Oteng RA, Becker TK. Sustainable Resuscitation Ultrasound Education in a Low-Resource Environment: The Kumasi Experience. Journal of Emergency Medicine. 2017;52(5):723-30.
88. Sabatino V, Caramia M, Curatola A, Vassallo F, Deidda A, Cinicola B, et al. Point-of-care ultrasound (POCUS) in a remote area of Sierra Leone: impact on patient management and training program for community health officers. Journal of ultrasound. 2020;23(4):521-7.
89. Rao V, DellaValle J, Gelin G, Day JA. Mission POCUS in Haiti. Journal of Radiology Nursing. 2023;42(1):77-84.
90. Harel-Sterling M, Kwan C, Pirie J, Tessaro M, Cho DD, Coblentz A, et al. Competency Standard Derivation for Point-of-Care Ultrasound Image Interpretation for Emergency Physicians. Annals of Emergency Medicine. 2023;81(4):413-26.
91. Bahner DP, Hughes D, Royall NA. I-AIM. Journal of Ultrasound in Medicine. 2012;31(2):295-300.
92. Reid S, Goffi A, Tsou E, Pivetta E, Pascoe S, Solis-McCarthy J, et al. ULTRA-Metrics. Journal of Ultrasound in Medicine.n/a(n/a).
Issue
Section
License
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by-nc/4.0) which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Transfer of Copyright and Permission to Reproduce Parts of Published Papers.
Authors retain the copyright for their published work. No formal permission will be required to reproduce parts (tables or illustrations) of published papers, provided the source is quoted appropriately and reproduction has no commercial intent. Reproductions with commercial intent will require written permission and payment of royalties.
How to Cite
