Multimodal system for automated medical documentation and clinical decision support integrating contact center solutions

The article presents the Parrot AI smart system, which supports physicians specialising in internal medicine and pediatrics. The solution is designed to automate time-consuming administrative processes and assist physicians in clinical decision-making. The main purpose of the system is to relieve medical staff of administrative tasks, such as manually filling out medical records, which translates into increased work efficiency and more time to focus on direct contact with patients. Parrot AI uses advanced natural language processing methods and generative language models to enable automated semantic analysis of medical interviews. Based on this, the system generates the content necessary to complete the electronic medical records and assists the physician by suggesting preliminary diagnoses and treatment options. Interaction with the patient can take place both at the initial medical interview stage (via chatbot or voicebot) and during a personal appointment at the clinic. Functional tests have demonstrated that the solution is highly effective. All tested components of the system achieved results well above the 80% effectiveness threshold, confirming the validity of further implementing the system into everyday clinical practice. Parrot AI has the potential not only to streamline physicians’ work, but also to improve the quality and consistency of medical records.