Real-time data integration in information systems using stream processing for medical data

TitleReal-time data integration in information systems using stream processing for medical data
Publication TypeJournal Article
Year of Publication2023
AuthorsKostov M, Kaloyanova K
JournalAnnuaire de l’Université de Sofia “St. Kliment Ohridski”. Faculté de Mathématiques et Informatique
Volume110
Start Page101
Pagination101-110
ISSN1313-9215 (Print) 2603-5529 (Online)
KeywordsApache Kafka, Apache Spark, data analysis, medical data, performance comparison, stream processing
Abstract

Real-time data processing in medical information systems is becoming harder with the increase in data volume. Stream processing is a popular approach for real-time data processing, which can process large volumes of data including medical in a scalable manner. In some cases, medical data may not be available in real time because of privacy and security concerns. In this paper, we will explore the use of stream processing with static medical data using streaming platforms, Kafka, and Apache Spark. We will demonstrate how these platforms can be used to work with static data in streams and discuss the benefits and limitations of the approach. We also present a case study to illustrate the effectiveness and performance.

DOI10.60063/GSU.FMI.110.101-110
AttachmentSize
PDF icon 110-101-110.pdf1.05 MB