Artigo Acesso aberto Produção Nacional Revisado por pares

Formative online quiz on hemotherapy from blood physiology to transfusion medicine: a pilot study conducted with Brazilian medical students

2018; American Physical Society; Volume: 42; Issue: 4 Linguagem: Inglês

10.1152/advan.00079.2018

ISSN

1522-1229

Autores

Marcella Martins de Vasconcelos Vaena, Luiz Anastácio Alves,

Tópico(s)

Simulation-Based Education in Healthcare

Resumo

IlluminationsFormative online quiz on hemotherapy from blood physiology to transfusion medicine: a pilot study conducted with Brazilian medical studentsMarcella Martins de Vasconcelos Vaena and Luiz Anastacio AlvesMarcella Martins de Vasconcelos VaenaCellular Communication Laboratory, Graduate Program in Education in Biosciences and Health, Oswaldo Cruz Institute, FIOCRUZ, Rio de Janeiro, Brazil and Luiz Anastacio AlvesCellular Communication Laboratory, Graduate Program in Education in Biosciences and Health, Oswaldo Cruz Institute, FIOCRUZ, Rio de Janeiro, BrazilPublished Online:10 Oct 2018https://doi.org/10.1152/advan.00079.2018MoreSectionsPDF (541 KB)Download PDF ToolsExport citationAdd to favoritesGet permissionsTrack citations ShareShare onFacebookTwitterLinkedInWeChat INTRODUCTIONThe use of internet-based games has become increasingly common as an educational strategy, and their effectiveness has been indicated in several studies (17, 18). In the health field, educational games have been applied to develop skills, define subject, and verify knowledge on certain themes (6). For the current student generation, digital natives who have grown accustomed to the internet, the use of educational tools that stimulate interactivity and autonomy in learning is important to motivate and maintain student interest (10, 20). In this context, in addition to the competences related to their area of expertise, teachers must also develop technological-digital competences that can facilitate the development of student knowledge (21).Quiz games consist of questions that assess student knowledge on a certain topic and function by applying the concept of formative feedback. In the educational context, this response aims to modify student thinking and behavior, leading to learning. Students receive feedback, so they can recognize their errors and seek to correct them, allowing for gradual knowledge building (22).Transfusion medicine is the medical specialty that uses blood transfusion, blood components, and derivatives as therapy. Blood transfusions are a widely applied procedure that can save lives (13). However, this method presents several patient risks, such as the possibility for the transmission of infectious diseases, transfusion reactions (7), and immunomodulation (5), and the inappropriate use of this therapy unnecessarily exposes patients to these risks.Several studies have pointed out a deficiency regarding medical knowledge in the transfusion medicine area and a need for the expansion and modification of specialty teaching strategies during medical training (8, 9, 11, 16). This problem seems to begin in physiology teaching, since most physiology books do not discuss relevant blood physiology aspects and their applications in clinical situations.In this context, with the aim of creating an auxiliary tool for transfusion medicine teaching and learning, a quiz comprising annotated clinical cases was developed, available on the website entitled "Sciences; an animated way of learning" (http://www.lcc.kftox.com/medical_education.html).The chosen themes were based on an earlier study regarding the evaluation of resident physician knowledge on the subject (24), and the topics were those for which resident physicians presented a lower percentage of correct answers considered essential to the practice.The software was tested by both specialists and medical students, who applied usability criteria, i.e., is the software easy to use, are its contents clear, and also evaluated the possibility of using the tool as an educational resource.METHODSThe quiz.The software was developed following choice of content, planning, prototype development, evaluation, validation and distribution steps (3). The content was based on specialized bibliography and reviewed by six experts, each one with more than 15 yr of experience in the field. The software can be accessed by both desktop (Fig. 1) and mobile devices, such as tablets and smartphones, on both iOS and Android operating systems (Fig. 1).Fig. 1.Desktop and Mobile Quiz Hemotherapy home screens, which are available in English and Portuguese.Download figureDownload PowerPointThe quiz is composed of 10 clinical cases covering hemotherapy topics, such as transfusion reactions, ABO/Rh compatibility, reversal of anticoagulant effects, and indication of platelet use. To answer the questions, knowledge on blood physiology and hemotherapy is required. Each question is composed of five statements, with only one correct choice, single best answer. The order of the options is altered with each move. After selecting the option, the user will receive a congratulatory message if he/she was successful, or an indication of the correct answer if he/she was wrong.Next, the user is directed to a screen with an explanation of the topic. For more extensive topics, a more complete text option with the title "Read more" is available. The sequence is repeated throughout the 10 questions. At the end, bibliographical references and the user's score are available. The option to review the game is then displayed, again showing all questions with the user-marked options and the correct options. If the results will be used for research, a consent form will be made available online that authorizes such use. This tool is planned for the next version. The software is registered as a free software with a 3.0 creative commons license.Software evaluation.Five specialists in transfusion medicine with more than 15 yr of experience in the area, each one from different hemotherapy services, in Rio de Janeiro and 32 undergraduate medical students from a private university in Rio de Janeiro attending their 10th and 11th semesters participated in the quiz evaluation. In Brazil, medical undergraduate schools comprise 12 semesters. The students were already attending their internship, the final practical portion of the medical course, and, therefore, already experience situations or cases like those described in the quiz. All signed a free and informed consent form, and the project was approved by Ethical Committee of Fundação Oswaldo Cruz.To test the software, the methodology reported by Sander et al. (19) was applied, with modifications. An instrument with assertions to be filled out on a five-point Likert scale, ranging from "totally agree" to "totally disagree," was applied in person. The students were also asked if they had received any type of training in transfusion medicine during their undergraduate medical education, and about their perception, if the specialty is important to their practice. In Brazil, students at this point are already practicing under supervision. Questions on their profile regarding the use of the internet were also applied, and a space for suggestions and criticisms was made available. The answers were anonymous, to avoid any kind of embarrassment, leading to bias.Regarding the experts, open questions about the appropriateness of the applied vocabulary, audience, clarity, and timeliness of the content were also asked.RESULTSSpecialist evaluation.The software evaluation by the specialists was positive, as they indicated that the software is easy to understand and that the content is up to date and is clearly expressed. The applied vocabulary was considered appropriate for both medical students and physicians. The quiz was pointed out as an educational tool suitable for use by undergraduate medical students in their fourth or fifth year, by resident physicians, and by physicians in general. The evaluations performed by the experts using the Likert scale are displayed in Fig. 2.Fig. 2.Likert scale to evaluate transfusion medicine specialist perceptions regarding the characteristics and usability of the software as a pedagogical tool.Download figureDownload PowerPointStudent profile.The median age of the undergraduate medical students who participated in the survey was 25.9 yr, with 53% men and 47% women. All participants stated that they used computers and the internet for many different functions, such as sending and receiving e-mails, research, work, and accessing social networks, among others. A total of 78.1% evaluated their computer knowledge as satisfactory or very satisfactory, whereas 75% reported that they used mobile devices more frequently than desktop devices to access the internet.All students considered transfusion medicine as an important part of their clinical practice, while 40.6% perceived their knowledge in the area as insufficient, 50% as basic, and 9.3% as intermediary.Student comments.Most students considered the tool useful as a teaching-learning resource. The main student suggestions were:• To have an options menu to directly access the questions• Create a "read more" button for optional access• Display explanations in the form of videos• Increase the levels of complexity in the addressed topics• Turn the quiz into an app by adding other themesSeveral compliments were received, as follows:• Very good, relevant topics;• Few questions, but well formulated with good explanations.Only two students wrote down negative comments, and both were about the size of the explanatory texts, which they considered to be very extensive. Figure 3 displays the results of the student evaluations using the Likert scale.Fig. 3.Likert-type scale to evaluate student perception involving the characteristics and usefulness of the software as a pedagogical tool.Download figureDownload PowerPointDISCUSSIONIn the internet era, with the immediate availability of a huge amount of information for students, raising their interest to seek and improve knowledge has required changes in educational strategies. In this context, the use of educational software can be a motivating strategy (12).In health education, games have been used to improve the performance of health professionals, by improving their knowledge and skills (15). Although further studies are required to prove their efficiency as an educational strategy, several experiences have demonstrated positive results regarding user acceptance, motivation, and increased interest in the addressed subjects (2).Quiz-type games have already been successfully applied in the medical field for teaching genetics, physiology, and dermatology, among others (4, 14, 23). In transfusion medicine, e-mails with quizzes (Transfusion News, Question of the Day, https://transfusionnews.com/path-questions/) have been applied for the continuing education of professionals in this area in several countries (15). Abney et al. (1) pointed out strategies so that online quizzes can be used in an integrated manner with the traditional curriculum in medical education. These include, for example, examining issues alongside colleagues and aligning educational objectives with the quiz contents.The Quiz Hemotherapy software was well received by both experts and medical students. All experts who evaluated the quiz considered that it brings benefits in understanding the subject and can complement textbook reading and recommended the use of the software to other interested parties. Most students assessed that the software brought benefits to the understanding of the covered topics and liked the method, considering that it could be used to complement traditional methodologies, such as expository classes and/or textbooks. Received suggestions will be considered for improvement in a future software release.The fact that all students perceive transfusion medicine as an important topic for their medical practice, and that 90.6% consider their knowledge in the area as insufficient or basic, reinforces the importance of the development of tools such as the one discussed herein, which can assist in specialty teaching aiming to ultimately broaden the knowledge and possibly improve the transfusion practice for physicians. Teachers and supervisors should be aware of this issue. Future studies are, however, required to assess the impact of the use of this tool on user performance.GRANTSThis study was supported by Fundação de Amparo à Pesquisa do Rio de Janeiro-FAPERJ, Conselho Nacional de Desenvolvimento Científico e Tecnológico, and IOC-Fundação Oswaldo Cruz.DISCLOSURESNo conflicts of interest, financial or otherwise, are declared by the authors.AUTHOR CONTRIBUTIONSM.M.d.V.V. and L.A.A. conceived and designed research; M.M.d.V.V. performed experiments; M.M.d.V.V. and L.A.A. analyzed data; M.M.d.V.V. and L.A.A. interpreted results of experiments; M.M.d.V.V. prepared figures; M.M.d.V.V. drafted manuscript; M.M.d.V.V. and L.A.A. approved final version of manuscript; L.A.A. edited and revised manuscript.ACKNOWLEDGMENTSThe authors thank Dr. Elizabeth Rose Celso de Souza, Dr. Fernanda Azevedo Silva, Dr. Flavia Miranda Gomes de Constantino Bandeira, Dr. Iara de Jesus Ferreira Motta, Maria Cristina Pessoa dos Santos, and Dr. Selma Magalhães Brito for reviewing the content of the software. We thank all of the teachers who participated and made possible the evaluation process of the software by the students.REFERENCES1. Abney AJ, Amin S, Kibble JD. Understanding factors affecting participation in online formative quizzes: an interview study. Adv Physiol Educ 41: 457–463, 2017. doi:10.1152/advan.00074.2017. Link | ISI | Google Scholar2. Akl EA, Kairouz VF, Sackett KM, Erdley WS, Mustafa RA, Flander M, Gabriel C, Schunemann H. Educational games for health professionals. Cochrane Libr 3: 1–47, 2013. doi:10.1002/14651858.CD006411.pub4.Crossref | Google Scholar3. Berçot FF, Fidalgo-Neto AA, Lopes RM, Faggioni T, Alves LA. Virtual immunology: software for teaching basic immunology. Biochem Mol Biol Educ 41: 377–383, 2013. doi:10.1002/bmb.20733. Crossref | PubMed | ISI | Google Scholar4. Berg RMG, Plovsing RR, Damgaard M. Teaching baroreflex physiology to medical students: a comparison of quiz-based and conventional teaching strategies in a laboratory exercise. Adv Physiol Educ 36: 147–153, 2012. doi:10.1152/advan.00011.2012. Link | ISI | Google Scholar5. Cata JP, Wang H, Gottumukkala V, Reuben J, Sessler DI. Inflammatory response, immunosuppression, and cancer recurrence after perioperative blood transfusions. Br J Anaesth 110: 690–701, 2013. doi:10.1093/bja/aet068. Crossref | PubMed | ISI | Google Scholar6. Courtier J, Webb EM, Phelps AS, Naeger DM. Assessing the learning potential of an interactive digital game versus an interactive-style didactic lecture: the continued importance of didactic teaching in medical student education. Pediatr Radiol 46: 1787–1796, 2016. doi:10.1007/s00247-016-3692-x. Crossref | PubMed | ISI | Google Scholar7. Vamvakas EC, Blajchman MA. Transfusion-related mortality: the ongoing risks of allogeneic blood transfusion and the available strategies for their prevention. Blood 113: 3406–3417, 2009. doi:10.1182/blood-2008-10-167643. Crossref | PubMed | ISI | Google Scholar8. Friedman MT. Blood transfusion practices: a little consistency please. Blood Transfus 9: 362–365, 2011. doi:10.2450/2011.0007-11. Crossref | PubMed | ISI | Google Scholar9. Graham J, Grant-Casey J, Alston R, Baker P, Pendry K. Assessing transfusion competency in junior doctors: a retrospective cohort study. Transfusion 54: 128–136, 2014. doi:10.1111/trf.12274. Crossref | PubMed | ISI | Google Scholar10. Han H, Resch DS, Kovach RA. Educational technology in medical education. Teach Learn Med 25, Suppl 1: S39–S43, 2013. doi:10.1080/10401334.2013.842914. Crossref | PubMed | ISI | Google Scholar11. Haspel RL, Lin Y, Mallick R, Tinmouth A, Cid J, Eichler H, Lozano M, van de Watering L, Fisher PB, Ali A, Parks E; BEST-TEST Investigators. Internal medicine resident knowledge of transfusion medicine: results from the BEST-TEST international education needs assessment. Transfusion 55: 1355–1361, 2015. doi:10.1111/trf.12968. Crossref | PubMed | ISI | Google Scholar12. Jucá SCS. A relevância dos softwares educativos na educação profissional. Ciênc Cogn 8: 22–28, 2006.Google Scholar13. Karp JK, Weston CM, King KE. Transfusion medicine in American undergraduate medical education. Transfusion 51: 2470–2479, 2011. doi:10.1111/j.1537-2995.2011.03154.x. Crossref | PubMed | ISI | Google Scholar14. Kunzler E, Graham J, Mostow E. Motivating medical students by utilizing dermatology-oriented online quizzes. Dermatol Online J 22: 6, 2016. PubMed | Google Scholar15. Lin Y, Haspel RL. Transfusion medicine education for non-transfusion medicine physicians: a structured review. Vox Sang 112: 97–104, 2017. doi:10.1111/vox.12499. Crossref | PubMed | ISI | Google Scholar16. O'Brien KL, Champeaux AL, Sundell ZE, Short MW, Roth BJ. Transfusion medicine knowledge in postgraduate year 1 residents. Transfusion 50: 1649–1653, 2010. doi:10.1111/j.1537-2995.2010.02628.x. Crossref | PubMed | ISI | Google Scholar17. Prensky M. Digital game-based learning. Comput Entertain 1: 21, 2003. doi:10.1145/950566.950596.Crossref | Google Scholar18. Pront L, Müller A, Koschade A, Hutton A. Gaming in nursing education: a literature review. Nurs Educ Perspect 39: 23–28, 2018. doi:10.1097/01.NEP.0000000000000251. Crossref | PubMed | ISI | Google Scholar19. Sander U, Kerlen G, Steinke M, Huk T, Floto C. Evaluation of two CD-ROMs from a series on cell biology. Cell Biol Educ 2: 256–265, 2003. doi:10.1187/cbe.03-01-0002. Crossref | PubMed | Google Scholar20. Schlemmer E. O trabalho do professor e as novas tecnologias. Textual Porto Alegre 1: 33–42, 2006.Google Scholar21. Schlemmer E. Formação de professores na modalidade on-line: experiências e reflexões sobre a criação de espaços de convivência digitais virtuais. Em Aberto 23: 99–122, 2010.Google Scholar22. Shute VJ. Focus on formative feedback. Rev Educ Res 78: 153–189, 2008. doi:10.3102/0034654307313795.Crossref | ISI | Google Scholar23. Silva JMA, Canedo RV, Abrantes TAS, Santos RT, Souza RA, Utagawa CY. Quiz: um questionário eletrônico para autoavaliação e aprendizagem em genética e biologia molecular. Rev Bras Educ Med 34: 607–614, 2010. doi:10.1590/S0100-55022010000400017.Crossref | Google Scholar24. Vaena MM, Alves LA. Assessment of the knowledge and perceptions of Brazilian medical residents on transfusion medicine. Hematol Transfus Cell Ther. In press. doi:10.1016/j.htct.2018.06.002.Crossref | Google ScholarAUTHOR NOTESAddress for reprint requests and other correspondence: M. Martins de Vasconcelos Vaena, Pós-graduação de Ensino de Biociências e Saúde, Laboratório de Comunicação Celular, Fundação Oswaldo Cruz, Av. Brasil 4365 Manguinhos, 21045-900 Rio de Janeiro, Brazil (e-mail: [email protected]com). Download PDF Previous Back to Top Next FiguresReferencesRelatedInformation Collections Cited ByEffect of an active learning methodology combined with formative assessments on performance, test anxiety, and stress of university studentsLais Tono Cardozo, Maria Antonia Ramos de Azevedo, Maeline Santos Morais Carvalho, Rafaela Costa, Patricia Oliveira de Lima, and Fernanda Klein Marcondes18 November 2020 | Advances in Physiology Education, Vol. 44, No. 4 More from this issue > Volume 42Issue 4December 2018Pages 644-647 Copyright & PermissionsCopyright © 2018 the American Physiological Societyhttps://doi.org/10.1152/advan.00079.2018PubMed30303413History Received 26 April 2018 Accepted 5 September 2018 Published online 10 October 2018 Published in print 1 December 2018 Metrics

Referência(s)