Publication details

Pitfalls in users' evaluation of algorithms for text-based similarity detection in medical education

Authors

ŠČAVNICKÝ Jakub KAROLYI Matěj RŮŽIČKOVÁ Petra POKORNÁ Andrea HARAZIM Hana ŠTOURAČ Petr KOMENDA Martin

Type Article in Proceedings
Conference PROCEEDINGS OF THE 2018 FEDERATED CONFERENCE ON COMPUTER SCIENCE AND INFORMATION SYSTEMS (FEDCSIS)
MU Faculty or unit

Faculty of Medicine

Citation
Web https://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=8490018
Keywords Correlation; education; medical diagnostic imaging; databases; tools; automobiles
Description This paper introduces a user evaluation of several approaches for an automated similarity detection between study materials and curriculum description in the field of medical and healthcare education. Our objective is to present an effective methodology of getting relevant feedback from medical students and teachers. Two various data sets (electronic study materials represented by interactive educational algorithms on the AKUTNE.CZ platform and the curriculum of the General Medicine study programme) are processed. For the purposes of this work, text similarity between two data sets is expressed lexically, i.e. character-based (n-gram) similarity as well as term-based similarity methods are used. We present the comparison of five selected approaches to similarity calculation as well as an objective discussion covering our experience with and pitfalls of user evaluation.
Related projects: