Readability of Online Pediatric Orthopaedic Trauma Patient Education Materials.
Diane Ghanem, John Avendano, Elizabeth Wang, Gabrielle Reichard, Aoife MacMahon, Aaron Brandt, Babar Shafiq
Author Information
Diane Ghanem: From the Department of Orthopaedic Surgery, The Johns Hopkins Hospital (Ghanem, Reichard, MacMahon, Brandt, and Shafiq), and the School of Medicine, The Johns Hopkins University, Baltimore, MD (Avendano and Wang). ORCID
INTRODUCTION: The importance of web resources for educating orthopaedic trauma patients is well recognized. Yet these resources often exceed the sixth-grade reading level and are too complex for most patients to understand. This study examines the readability of the American Academy of Orthopaedic Surgeons' (AAOS) pediatric trauma-related educational content compared with similar materials from the Pediatric Orthopaedic Society of North America (POSNA). METHODS: Eleven AAOS ( https://www.orthoinfo.org/ ) and nine POSNA ( https://orthokids.org ) pediatric trauma education articles were included. Articles' readability was assessed by two independent examiners using (1) the Flesch-Kincaid Grade Level (FKGL) and the Flesch Reading Ease (FRE) algorithms. The FKGL mean was compared with the sixth-grade level and the average American reading level using a one-sample t -test. A two-sample t -test evaluated the differences in readability between the AAOS and POSNA materials. RESULTS: A total of 15 unique articles were included. Excellent agreement (>90%) was noted between reviewers for FKGL and FRE. The average (SD) FKGL for AAOS and POSNA articles were 8.5 (0.8) and 9.0 (1.5), respectively, and the FRE scores were 61.2 (3.8) for AAOS and 61.7 (7.7) for POSNA. Only one AAOS article met the sixth-grade reading level. The average readability levels of the AAOS and POSNA articles were markedly higher than the recommended sixth-grade level ( P < 0.001). No notable difference was found in FKGL ( P = 0.47) or FRE ( P = 0.89) when comparing AAOS and POSNA articles. DISCUSSION: This study indicates that the readability of the AAOS pediatric trauma and POSNA trauma-related articles is well above that which is recommended for the general public, and this has remained so for more than a decade. Both POSNA and AAOS trauma education materials have high readability levels, potentially hindering patient understanding. Improving the readability of these widely used trauma education resources is overdue and will likely improve patient comprehension.
References
Ghanem D, Covarrubias O, Harris AB, Shafiq B: Readability of the Orthopaedic Trauma Association Patient Education Tool. J Orthop Trauma 2023;37:e307-e311.
Ghanem D, Covarrubias O, Maxson R, Sabharwal S, Shafiq B: Readability of trauma-related patient education materials from the American Academy of Orthopaedic Surgeons and Orthopaedic Trauma Association websites. J Am Acad Orthop Surg 2024;32:e642-e650.
Dekkers T, Melles M, Groeneveld BS, de Ridder H: Web-based patient education in orthopedics: Systematic review. J Med Internet Res 2018;20:e143.
Hirsch SA: Academy introduces web-based medical education for fellows and patients. J Bone Joint Surg Am 2000;82:1665-1667.
Peterlein CD, Bosch M, Timmesfeld N, Fuchs-Winkelmann S: Parental internet search in the field of pediatric orthopedics. Eur J Pediatr 2019;178:929-935.
Ó Doinn T, Broderick JM, Abdelhalim MM, Quinlan JF: Readability of patient educational materials in pediatric orthopaedics. J Bone Joint Surg Am 2021;103:e47.
Sabharwal S, Badarudeen S, Unes Kunju S: Readability of online patient education materials from the AAOS web site. Clin Orthop Relat Res 2008;466:1245-1250.
Badarudeen S, Sabharwal S: Readability of patient education materials from the American Academy of Orthopaedic Surgeons and Pediatric Orthopaedic Society of North America web sites. J Bone Joint Surg Am 2008;90:199-204.
Ratzan S, Parker R, Selden C, Zorn M: National Library of Medicine Current Bibliographies in Medicine: Health Literacy. Bethesda, MD, National Institutes of Health, 2000.
Baker DW, Parker RM, Williams MV, Clark WS, Nurss J: The relationship of patient reading ability to self-reported health and use of health services. Am J Public Health 1997;87:1027-1030.
Albright J, de Guzman C, Acebo P, Paiva D, Faulkner M, Swanson J: Readability of patient education materials: Implications for clinical practice. Appl Nurs Res 1996;9:139-143.
Doak CC, Doak LG, Root JH: Teaching patients with low literacy skills. Am J Nurs 1996;96:16M.
Badarudeen S, Sabharwal S: Assessing readability of patient education materials: Current role in orthopaedics. Clin Orthop Relat Res 2010;468:2572-2580.
Yi PH, Ganta A, Hussein KI, Frank RM, Jawa A: Readability of arthroscopy-related patient education materials from the American Academy of Orthopaedic Surgeons and Arthroscopy Association of North America web sites. Arthroscopy 2013;29:1108-1112.
Ganta A, Yi PH, Hussein K, Frank RM: Readability of sports medicine-related patient education materials from the American Academy of Orthopaedic Surgeons and the American Orthopaedic Society for Sports Medicine. Am J Orthop (Belle Mead NJ) 2014;43:E65-E68.
Roberts H, Zhang D, Dyer GSM: The readability of AAOS patient education materials: Evaluating the progress since 2008. J Bone Joint Surg Am 2016;98:e70.
Eltorai AEM, Thomas N, Yang H, Daniels AH, Born CT: Readability of trauma-related patient education materials from the American Academy of Orthopaedic Surgeons. Trauma Mon 2016;21:e20141.
Mohan R, Yi PH, Morshed S: Readability of orthopedic trauma patient education materials on the internet. Am J Orthop (Belle Mead NJ) 2017;46:E190-E194.
Michel C, Dijanic C, Abdelmalek G, et al.: Readability assessment of patient educational materials for pediatric spinal conditions from top academic orthopedic institutions. J Child Orthop 2023;17:284-290. Accessed April 4, 2024.
Gill B, Bonamer J, Kuechly H, et al.: ChatGPT is a promising tool to increase readability of orthopedic research consents. J Orthop Trauma Rehabil 2024. 10.1177/22104917231208212
[DOI: 10.1177/22104917231208212]
Friedman DB, Hoffman-Goetz L: A systematic review of readability and comprehension instruments used for print and web-based cancer information. Health Educ Behav 2006;33:352-373.
Kutner M, Greenberg E, Baer J: 2 Description of Literacy Levels 2 Assessment Design 2 Defining Literacy 4 Changes in Adult Literacy 4 Nonliterate in English 5 Profile of Adults With Below Basic Prose Literacy Average Prose and Document Literacy Scores Rise for Blacks and Asians But Decrease Among Hispanics, 1992. Available at: http://books.nap.edu/ .
Ley P, Florio T: The use of readability formulas in health care. Psychol Health Med 1996;1:7-28. Accessed April 4, 2024.
Perez JL, Mosher ZA, Watson SL, et al.: Readability of orthopaedic patient-reported outcome measures: Is there a fundamental failure to communicate? Clin Orthop Relat Res 2017;475:1936-1947.
Flesch R: A new readability yardstick. J Appl Psychol 1948;31(2):148-152.
Kincaid J, Fishburne R, Rogers R, Chissom B: Derivation of New Readability Formulas (Automated Readability Index, Fog Count and Flesch Reading Ease Formula) For Navy Enlisted Personnel. Available at: http://library.ucf.edu .
Patetta MJ, Pond KM, Tennant EM, Sood A, Gonzalez MH: Readability level of English and Spanish orthopaedic patient education materials English and Spanish patient education. J Surg Orthop Adv 2021;30:96-100.
