Effectiveness of a portfolio model on the performance of the virtual osce
DOI:
https://doi.org/10.37467/revtechno.v13.4788Keywords:
COVID-19, Effectiveness, Medicine, Model, OSCEAbstract
We evaluated the effectiveness of the portfolio combined with the flipped classroom, team-based learning, and online videos on students' performance in a virtual OSCE and their perception of the attributes of the OSCE and videos.
The integration of the virtual OSCE in a medicine program manages the need to be on campus in the context of COVID-19, requires minimal technological resources, fulfills the main objective of creating a format of acceptable, low cost, and low administrative burden, and can be implemented in a short period.
References
Al-Mously, N., Nabil, N. M., & Salem, R. (2012). Student Feedback on OSPE: An Experience of a New Medical School in Saudi Arabia. Medical Science Educator, 22(1), 10–16. https://doi.org/10.1007/BF03341746 DOI: https://doi.org/10.1007/BF03341746
Allen, R., Heard, J., Savidge, M., Bittergle, J., Cantrell, M., & Huffmaster, T. (1998). Surveying Students’ Attitudes During the OSCE. Advances in Health Sciences Education, 3, 197–206. DOI: https://doi.org/10.1023/A:1009796201104
Anderson, M., & Stickley, T. (2002). Finding reality: the use of objective structured clinical examination (OSCE) in the assessment of mental health nursing students interpersonal skills. Nurse Education in Practice, 2(3), 160–168. https://doi.org/10.1054/nepr.2002.0067 DOI: https://doi.org/10.1054/nepr.2002.0067
Azim Majumder, A., Kumar, A., Krishnamurthy, K., Ojeh, N., Adams, O. P., & Sa, B. (2019). An evaluative study of objective structured clinical examination (OSCE): students and examiners perspectives. Advances in Medical Education and Practice, Volume 10, 387–397. https://doi.org/10.2147/AMEP.S197275 DOI: https://doi.org/10.2147/AMEP.S197275
Baig, M., Gazzaz, Z., & Farooq, M. (2020). Blended Learning: The impact of blackboard formative assessment on the final marks and students’ perception of its effectiveness. Pakistan Journal of Medical Sciences, 36. https://doi.org/10.12669/pjms.36.3.1925 DOI: https://doi.org/10.12669/pjms.36.3.1925
Bedford, J., Enria, D., Giesecke, J., Heymann, D. L., Ihekweazu, C., Kobinger, G., Lane, H. C., Memish, Z., Oh, M., Sall, A. A., Schuchat, A., Ungchusak, K., & Wieler, L. H. (2020). COVID-19: towards controlling of a pandemic. The Lancet, 395(10229), 1015–1018. https://doi.org/10.1016/S0140-6736(20)30673-5 DOI: https://doi.org/10.1016/S0140-6736(20)30673-5
Bevan, J., Russell, B., & Marshall, B. (2019). A new approach to OSCE preparation - PrOSCEs. BMC Medical Education, 19. https://doi.org/10.1186/s12909-019-1571-5 DOI: https://doi.org/10.1186/s12909-019-1571-5
Boursicot, K., Kemp, S., Ong, T., Wijaya, L., Goh, S., Freeman, K., & Curran, I. (2020). Conducting a high-stakes OSCE in a COVID-19 environment. MedEdPublish, 9. https://doi.org/10.15694/mep.2020.000054.1 DOI: https://doi.org/10.15694/mep.2020.000054.1
Brand, H. S., & Schoonheim-Klein, M. (2009). Is the OSCE more stressful? Examination anxiety and its consequences in different assessment methods in dental education. European Journal of Dental Education, 13(3), 147–153. https://doi.org/10.1111/j.1600-0579.2008.00554.x DOI: https://doi.org/10.1111/j.1600-0579.2008.00554.x
Díaz-Plasencia, J. A., Sánchez de Cáceda, E., Guzmán-Gavidia, C., Valencia-Mariñas, H., García-Cabrera, J., Yan-Quiroz, E., & Díaz-Villazón, M. (2016). Fiabilidad y validez de un portafolio reflexivo en la evaluación de la práctica clínica de los estudiantes del capítulo de Cirugía Oncológica del curso de Cirugía. Revista de La Fundación Educación Médica, 19(4), 175. https://doi.org/10.33588/fem.194.846 DOI: https://doi.org/10.33588/fem.194.846
Diaz-Plasencia, J., Moreno-Castillo, P. A., Calmet, J., Yan, E., Díaz Villazón, M., Iglesias-Obando, A., Zegarra-Castillo, K., & Urquiaga-Ríos, K. (2016). Validez concurrente del examen clínico objetivo estructurado con el portafolio electrónico, examen teórico y promedio ponderado en estudiantes de cirugía de la Universidad Privada Antenor Orrego. Revista de La Fundación Educación Médica, 19, 237. https://doi.org/10.33588/fem.195.855 DOI: https://doi.org/10.33588/fem.195.855
Dinscore, A., & Andres, A. (2010). Surgical Videos Online: A Survey of Prominent Sources and Future Trends. Medical Reference Services Quarterly, 29(1), 10–27. https://doi.org/10.1080/02763860903484996 DOI: https://doi.org/10.1080/02763860903484996
Donkin, R., Askew, E., & Stevenson, H. (2019). Video feedback and e-Learning enhances laboratory skills and engagement in medical laboratory science students. BMC Medical Education, 19(1), 310. https://doi.org/10.1186/s12909-019-1745-1 DOI: https://doi.org/10.1186/s12909-019-1745-1
Duvivier, R. J., van Geel, K., van Dalen, J., Scherpbier, A. J. J. A., & der Vleuten, C. P. M. Van. (2012). Learning physical examination skills outside timetabled training sessions: what happens and why? Advances in Health Sciences Education, 17, 339–355. DOI: https://doi.org/10.1007/s10459-011-9312-5
Elfaki, O., & Al-Humayed, S. (2016). Medical Students’ Perception of OSCE at the Department of Internal Medicine, College of Medicine, King Khalid University, Abha, KSA. Journal of the College of Physicians and Surgeons--Pakistan : JCPSP, 26 2, 158–159.
Ellaway, R., & Masters, K. (2008). AMEE Guide 32: E-Learning in medical education Part 1: Learning, teaching and assessment. Medical Teacher, 30(5). https://doi.org/10.1080/01421590802108331 DOI: https://doi.org/10.1080/01421590802108331
Epstein, R. M. (2007). Assessment in Medical Education. New England Journal of Medicine, 356(4), 387–396. https://doi.org/10.1056/NEJMra054784 DOI: https://doi.org/10.1056/NEJMra054784
Faria, A. L., Perdigão, A. C. B., Marçal, E., Kubrusly, M., & Peixoto, Raquel Autran Coelho Junior, A. A. P. (2020). OSCE 3D: a virtual clinical skills assessment tool for coronavirus pandemic times. Research Square. https://doi.org/10.21203/rs.3.rs-25191/v1 DOI: https://doi.org/10.21203/rs.3.rs-25191/v1
Figueroa, C. (2004). Sistemas de evaluación académica. (Editorial Universitaria. (ed.); Primera).
Furlong, E., Fox, P., Lavin, M., & Collins, R. (2005). Oncology nursing students’ views of a modified OSCE. European Journal of Oncology Nursing, 9(4), 351–359. https://doi.org/10.1016/j.ejon.2005.03.001 DOI: https://doi.org/10.1016/j.ejon.2005.03.001
García-Estañ, J. (2013). Prueba Nacional de Evaluación de Competencias Clínicas de la Conferencia Nacional de Decanos de Facultades de Medicina de ESP. FEM, 16, S59–S62.
García-Puig, J., Vara-Pinedo, F., & Vargas-Núñez, J. A. (2018). Implantación del Examen Clínico Objetivo y Estructurado en la Facultad de Medicina de la Universidad Autónoma de Madrid. Educación Médica, 19(3), 178–187. https://doi.org/10.1016/j.edumed.2017.01.003 DOI: https://doi.org/10.1016/j.edumed.2017.01.003
Gormley, G. J., Collins, K., Boohan, M., Bickle, I. C., & Stevenson, M. (2009). Is there a place for e-learning in clinical skills? A survey of undergraduate medical students’ experiences and attitudes. Medical Teacher, 31(1), e6–e12. https://doi.org/10.1080/01421590802334317 DOI: https://doi.org/10.1080/01421590802334317
Harden, R., Lilley, P., & Patricio, M. (2015). The Definitive Guide to the OSCE (1st editio). ELSEVIER.
Harden, R. M. (2015). Misconceptions and the OSCE. Medical Teacher, 37(7), 608–610. https://doi.org/10.3109/0142159X.2015.1042443 DOI: https://doi.org/10.3109/0142159X.2015.1042443
Hochlehnert, A., Schultz, J., Möltner, A., Tımbıl, S., Brass, K., & Jünger, J. (2015). Electronic acquisition of OSCE performance using tablets. GMS Zeitschrift Fü Medizinische Ausbildung, 32(4). https://doi.org/10.3205/zma000983
Hoppe, R. B., Farquhar, L. J., Henry, R. C., Stoffelmayr, B. E., & Helfer, M. (1988). A course component to teach interviewing skills in informing and motivating patients. Journal of Medical Education, 63 3, 176–181. DOI: https://doi.org/10.1097/00001888-198803000-00004
Jang, H. W., & Kim, K.-J. (2014). Use of online clinical videos for clinical skills training for medical students: benefits and challenges. BMC Medical Education, 14(1), 56. https://doi.org/10.1186/1472-6920-14-56 DOI: https://doi.org/10.1186/1472-6920-14-56
Jindal, P., & Khurana, G. (2016). The opinion of post graduate students on objective structured clinical examination in Anaesthesiology: A preliminary report. Indian Journal of Anaesthesia, 60(3), 168. https://doi.org/10.4103/0019-5049.177869 DOI: https://doi.org/10.4103/0019-5049.177869
Jowett, N., Leblanc, V., Xeroulis, G., Macrae, H., & Dubrowski, A. (2007). Surgical skill acquisition with self-directed practice using computer-based video training. American Journal of Surgery, 193 2, 237–242. DOI: https://doi.org/10.1016/j.amjsurg.2006.11.003
Khan, A., Ayub, M., & Shah, Z. (2016). An Audit of the Medical Students’ Perceptions regarding Objective Structured Clinical Examination. Education Research International, 2016, 1–4. https://doi.org/10.1155/2016/4806398 DOI: https://doi.org/10.1155/2016/4806398
Khan, H. (2017). OSCES are outdated: clinical skills assessment should be centred around workplace-based assessments (WPBAS) to put the ‘art’ back into medicine. MedEdPublish, 6(4). https://doi.org/10.15694/mep.2017.000189 DOI: https://doi.org/10.15694/mep.2017.000189
Khogali, S. E. O., Davies, D. A., Donnan, P. T., Gray, A., Harden, R. M., Mcdonald, J., Pippard, M. J., Pringle, S. D., & Yu, N. (2011). Integration of e-learning resources into a medical school curriculum. Medical Teacher, 33(4), 311–318. https://doi.org/10.3109/0142159X.2011.540270 DOI: https://doi.org/10.3109/0142159X.2011.540270
Kuhn, S., Frankenhauser, S., & Tolks, D. (2018). Digitale Lehr- und Lernangebote in der medizinischen Ausbildung. Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz, 61(2), 201–209. https://doi.org/10.1007/s00103-017-2673-z DOI: https://doi.org/10.1007/s00103-017-2673-z
Lara, S., Foster, C. W., Hawks, M., & Montgomery, M. (2020). Remote Assessment of Clinical Skills During COVID-19: A Virtual, High-Stakes, Summative Pediatric Objective Structured Clinical Examination. Academic Pediatrics, 20(6), 760—761. https://doi.org/10.1016/j.acap.2020.05.029 DOI: https://doi.org/10.1016/j.acap.2020.05.029
Lee, J., Boyd, R., & Stuart, P. (2007). Randomized controlled trial of an instructional DVD for clinical skills teaching. Emergency Medicine Australasia : EMA, 19, 241–245. https://doi.org/10.1111/j.1742-6723.2007.00976.x DOI: https://doi.org/10.1111/j.1742-6723.2007.00976.x
Li, L., Xv, Q., & Yan, J. (2020). COVID-19: the need for continuous medical education and training. The Lancet Respiratory Medicine, 8(4), e23. https://doi.org/10.1016/S2213-2600(20)30125-9 DOI: https://doi.org/10.1016/S2213-2600(20)30125-9
Major, S., Sawan, L., Vognsen, J., & Jabre, M. (2020). COVID-19 pandemic prompts the development of a Web-OSCE using Zoom teleconferencing to resume medical students’ clinical skills training at Weill Cornell Medicine-Qatar. BMJ Simulation and Technology Enhanced Learning, bmjstel-2020. https://doi.org/10.1136/bmjstel-2020-000629 DOI: https://doi.org/10.1136/bmjstel-2020-000629
Marshall, G., & Jones, N. (2003). A pilot study into the anxiety induced by various assessment methods. Radiography, 9(3), 185–191. https://doi.org/10.1016/S1078-8174(03)00062-2 DOI: https://doi.org/10.1016/S1078-8174(03)00062-2
Matos, D. (2020). Los problemas más comunes en Zoom (y cómo solucionarlos). Digitaltrends. https://es.digitaltrends.com/computadoras/problemas-comunes-en-zoom/
Mavis, B. (2000). Does studying for an objective structured clinical examination make a difference? Medical Education, 34, 808–812. DOI: https://doi.org/10.1046/j.1365-2923.2000.00687.x
Mavis, B. (2001). Self-Efficacy and OSCE Performance among Second Year Medical Students. Advances in Health Sciences Education : Theory and Practice, 6, 93–102. https://doi.org/10.1023/A:1011404132508 DOI: https://doi.org/10.1023/A:1011404132508
McLaughlin, M., & Brame, D. (2020). The Best Video Conferencing Software for 2020. PCmag. https://www.pcmag.com/picks/the-best-video-conferencing-software
McMahon, G. T., Ingelfinger, J. R., & Campion, E. W. (2006). Videos in Clinical Medicine — A New Journal Feature. New England Journal of Medicine, 354(15), 1635–1635. https://doi.org/10.1056/NEJMe068044 DOI: https://doi.org/10.1056/NEJMe068044
Merrick, H., Nowacek, G., Boyer, J., & Robertson, J. (2000). Comparison of the Objective Structured Clinical Examination with the performance of third-year medical students in surgery. American Journal of Surgery, 179, 286–288. https://doi.org/10.1016/S0002-9610(00)00340-8 DOI: https://doi.org/10.1016/S0002-9610(00)00340-8
Mian, A., & Khan, S. (2020). Medical education during pandemics: a UK perspective. BMC Medicine, 18(1), 100. https://doi.org/10.1186/s12916-020-01577-y DOI: https://doi.org/10.1186/s12916-020-01577-y
Michel, L. P., Goertz, L., Radomski, S., Fritsch, T., & Baschour, L. (2015). DIGITALES PRÜFEN UND BEWERTEN IM HOCHSCHULBEREICH. Geschäftsstelle Hochschulforum Digitalisierung. https://www.che.de/download/hfd_studie_digitalespruefen-pdf/?wpdmdl=10551&refresh=5f4be7dab55b31598810074
Minion, D., Donnelly, M., Quick, R., Pulito, A., & Schwartz, R. (2002). Are multiple objective measures of student performance necessary? American Journal of Surgery, 183 6, 663–665. DOI: https://doi.org/10.1016/S0002-9610(02)00868-1
Musa, T. H., Ahmad, T., Khan, M., Haroon, H., & Wei, P. (2020). Global outbreak of 2019-nCoV, a new challenge? The Journal of Infection in Developing Countries, 14(03), 244–245. https://doi.org/10.3855/jidc.12530 DOI: https://doi.org/10.3855/jidc.12530
Novack, D. H., Cohen, D., Peitzman, S. J., Beadenkopf, S., Gracely, E., & Morris, J. (2002). A pilot test of WebOSCE: a system for assessing trainees’ clinical skills via teleconference. Medical Teacher, 24(5), 483–487. https://doi.org/10.1080/0142159021000012504 DOI: https://doi.org/10.1080/0142159021000012504
Omu, A. E., Al-Azemi, M. K., Omu, F. E., Al-Harmi, J., & Diejomaoh, M. F. E. (2016). Attitudes of Academic Staff and Students towards the Objective Structured Clinical Examination (OSCE) in Obstetrics and Gynaecology. Creative Education, 07(06), 886–897. https://doi.org/10.4236/ce.2016.76093 DOI: https://doi.org/10.4236/ce.2016.76093
Padilha, J. M., Machado, P. P., Ribeiro, A., Ramos, J., & Costa, P. (2019). Clinical Virtual Simulation in Nursing Education: Randomized Controlled Trial. Journal of Medical Internet Research, 21(3), e11529. https://doi.org/10.2196/11529 DOI: https://doi.org/10.2196/11529
Patil, N. G., & Yan, Y. C. H. (2003). SARS and its effect on medical education in Hong Kong. Medical Education, 37(12), 1127–1128. https://doi.org/10.1046/j.1365-2923.2003.01723.x DOI: https://doi.org/10.1046/j.1365-2923.2003.01723.x
Pierre, R., Wierenga, A., Barton, M., Branday, J., & Christie, C. (2004). Student evaluation of an OSCE in Paediatric at the University of the West Indies, Jamaica. BMC Medical Education, 4, 22. https://doi.org/10.1186/1472-6920-4-22 DOI: https://doi.org/10.1186/1472-6920-4-22
Prettyman, A. V., Knight, E. P., & Allison, T. E. (2018). Objective Structured Clinical Examination From Virtually Anywhere! The Journal for Nurse Practitioners, 14(8), e157–e163. https://doi.org/10.1016/j.nurpra.2018.05.007 DOI: https://doi.org/10.1016/j.nurpra.2018.05.007
Race, P., & Pickford, R. (2007). Making teaching work: ‘Teaching smarter’ in post-compulsory education. https://doi.org/10.4135/9781446214886 DOI: https://doi.org/10.4135/9781446214886
Raiman, L., Antbring, R., & Mahmood, A. (2017). WhatsApp messenger as a tool to supplement medical education for medical students on clinical attachment. BMC Medical Education, 17. DOI: https://doi.org/10.1186/s12909-017-0855-x
Robinson, P., Morton, L., Haran, H., & Manton, R. (2017). Mock OSCEs Improve Medical Students’ Confidence and Reduce Anxiety Related to Summative Examinations. Education in Medicine Journal, 9(2), 41–45. https://doi.org/10.21315/eimj2017.9.2.4 DOI: https://doi.org/10.21315/eimj2017.9.2.4
Round, J., Conradi, E., & Poulton, T. (2007, March 23). A Workable Model for Virtual Patient Design. E-Learning Unit, CMHCE, St George’s University of London. http://www.jround.co.uk/virtual_patients/papers/workable_vp.htm
Sarid, O., Anson, O., & Bentov, Y. (2005). Students’ Reactions to Three Typical Examinations in Health Sciences. Advances in Health Sciences Education, 10(4), 291–302. https://doi.org/10.1007/s10459-005-6706-2 DOI: https://doi.org/10.1007/s10459-005-6706-2
Schapiro, R., Stickford-Becker, A., Foertsch, J., Remington, P., & Seibert, C. (2011). Integrative Cases for Preclinical Medical Students Connecting Clinical, Basic Science, and Public Health Approaches. American Journal of Preventive Medicine, 41, S187-92. https://doi.org/10.1016/j.amepre.2011.06.004 DOI: https://doi.org/10.1016/j.amepre.2011.06.004
Schoonheim-Klein, M., Hoogstraten, J., Habets, L., Aartman, I., Van der Vleuten, C., Manogue, M., & Van der Velden, U. (2007). Language background and OSCE performance: a study of potential bias. European Journal of Dental Education, 11(4), 222–229. https://doi.org/10.1111/j.1600-0579.2007.00459.x DOI: https://doi.org/10.1111/j.1600-0579.2007.00459.x
Shitu, B., & Girma, T. (2008). OBJECTIVE STRUCTURED CLINICAL EXAMINATION (OSCE): EXAMINEE´S PERCEPTION AT DEPARTMENT OF PEDIATRICS AND CHILD HEALTH, JIMMA UNIVERSITY. Ethiop J Health Sci., 18(2), 47–52.
Skrzypek, A., Szeliga, M., Stalmach-Przygoda, A., Górski, S., Kowalska, B., Kocurek, A., & Nowakowski, M. (2017). The Objective Structured Clinical Examination (OSCE) from the perspective of 3rd year’s medical students - a pilot study. Folia Medica Cracoviensia, 57, 67–75.
Stowe, C. D., & Gardner, S. F. (2005). Real-Time Standardized Participant Grading of an Objective Structured Clinical Examination. American Journal of Pharmaceutical Education, 69(3), 41. https://doi.org/10.5688/aj690341 DOI: https://doi.org/10.5688/aj690341
Sutherland, S., & Jalali, A. (2017). Social media as an open-learning resource in medical education: current perspectives. Advances in Medical Education and Practice, Volume 8, 369–375. https://doi.org/10.2147/AMEP.S112594 DOI: https://doi.org/10.2147/AMEP.S112594
Swicegood, J., & Haque, S. (2015). Lessons from Recruiting Second Life Users with Chronic Medical Conditions: Applications for Health Communications. Journal For Virtual Worlds Research, 8(1). https://doi.org/10.4101/jvwr.v8i1.7097 DOI: https://doi.org/10.4101/jvwr.v8i1.7097
Taha, M., Abdalla, M. E., Wadi, M., & Khalafalla, H. (2020). Curriculum delivery in Medical Education during an emergency: A guide based on the responses to the COVID-19 pandemic. MedEdPublish, 9. https://doi.org/10.15694/mep.2020.000069.1 DOI: https://doi.org/10.15694/mep.2020.000069.1
Thamburaj, A. J., Brass, K., Herrmann, M., & Jünger, J. (2015). 8 meeting of the medical assessment consortium UCAN: “Collaborative Perspectives for Competency-based and Quality-assured Medical Assessment.” GMS Zeitschrift Fü Medizinische Ausbildung, 32(4). https://doi.org/10.3205/zma000979
Troncon, L. E. de A. (2004). Clinical skills assessment: limitations to the introduction of an “OSCE” (Objective Structured Clinical Examination) in a traditional Brazilian medical school. Sao Paulo Medical Journal, 122(1), 12–17. https://doi.org/10.1590/S1516-31802004000100004 DOI: https://doi.org/10.1590/S1516-31802004000100004
Waxman, K. T., & Telles, C. L. (2009). The Use of Benner’s Framework in High-fidelity Simulation Faculty Development. Clinical Simulation in Nursing, 5(6), e231–e235. https://doi.org/10.1016/j.ecns.2009.06.001 DOI: https://doi.org/10.1016/j.ecns.2009.06.001
Xeroulis, G., Park, J., Moulton, C., Reznick, R., LeBlanc, V., & Dubrowski, A. (2007). Teaching suturing and knot-tying skills to medical students: A randomized controlled study comparing computer-based video instruction and (concurrent and summary) expert feedback. Surgery, 141, 442–449. https://doi.org/10.1016/j.surg.2006.09.012 DOI: https://doi.org/10.1016/j.surg.2006.09.012
Yang, W., Hebert, D., Kim, S., & Kang, B. (2019). MCRDR Knowledge-Based 3D Dialogue Simulation in Clinical Training and Assessment. Journal of Medical Systems, 43(7), 200. https://doi.org/10.1007/s10916-019-1262-0 DOI: https://doi.org/10.1007/s10916-019-1262-0
Young, I., Montgomery, K., Kearns, P., Hayward, S., & Mellanby, E. (2014). The benefits of a peer-assisted mock OSCE. The Clinical Teacher, 11(3), 214–218. https://doi.org/10.1111/tct.12112 DOI: https://doi.org/10.1111/tct.12112
Yu, T.-C., Wilson, N., Singh, P. (Parry), Lemanu, D., Hawken, S., & Hill, A. (2011). Medical students-as-teachers: A systematic review of peer-assisted teaching during medical school. Advances in Medical Education and Practice, 2, 157–172. https://doi.org/10.2147/AMEP.S14383 DOI: https://doi.org/10.2147/AMEP.S14383
Zartman, R. R., McWhorter, A., Seale, N., & Boone, W. (2002). Using OSCE-based evaluation: curricular impact over time. Journal of Dental Education, 66 12, 1323–1330. DOI: https://doi.org/10.1002/j.0022-0337.2002.66.12.tb03605.x
Downloads
Published
How to Cite
Issue
Section
License
Those authors who publish in this journal accept the following terms:
- Authors will keep the moral right of the work and they will transfer the commercial rights.
- After 1 year from publication, the work shall thereafter be open access online on our website, but will retain copyright.
- In the event that the authors wish to assign an Creative Commons (CC) license, they may request it by writing to publishing@eagora.org
