Evaluating an information and communication technology‐based emergency medical services system for enhancing emergency patient transportation: A preliminary pilot survey‐based analysis

Abstract Objective To conduct a preliminary pilot evaluation of the usability, acceptability, feasibility, and appropriateness of an information and communication technology‐based emergency medical services (ICT‐EMS) system implemented to support prehospital emergency patient transport in medically underserved region of South Korea. Methods This prospective observational pilot study was conducted among specially trained emergency medical technicians (EMTs) assigned to 12 fire stations in North Chungcheong Province. Between June and October 2023, 108 EMTs used the ICT‐Ems system during prehospital carea. After a 2‐month implementation period, 74 EMTs completed a structured survey assessing usability (system usability scale, SUS), acceptability (acceptability of intervention measure, AIM), feasibility (feasibility of intervention measure, FIM), appropriateness (intervention appropriateness measure, IAM), and overall satisfaction. Group comparisons and multivariable linear regression analyses were performed to identify factors associated with implementation outcomes. Results The median overall SUS score was 36.0, indicating poor perceived usability. Mean scores for acceptability, feasibility, appropriateness, and satisfaction were 3.0, 2.9, 2.8, and 2.7 (out of 5), respectively. EMTs working in rural areas, those with longer professional experience, and those with prior ICT‐EMS use tended to report higher usability and implementation outcome scores. In multivariable analyses, moderate system use (1–50 cases) was independently associated with higher feasibility and appropriateness scores, whereas no factors showed a statistically significant independent association with SUS scores. Conclusions Although the ICT‐EMS system may offer potential benefits in medically underserved and rural settings, its current usability remains below accepted benchmarks. Substantial system redesign, user‐centered interface improvements, and longer‐term evaluations involving broader EMS personnel and hospital stakeholders are required before wider adoption can be recommended.