Frontiers in Emerging Multidisciplinary Sciences

Open Access Peer Review International
Open Access

Adopting Data Streaming Middleware for Reactive Infrastructure Development in Modern Financial Systems

4 Hanoi University of Technology, Vietnam

Abstract

Modern financial systems operate under increasing pressure to process large-scale transactional data in real time while maintaining high availability, scalability, and fault tolerance. Traditional batch-oriented and tightly coupled architectures are insufficient to meet the demands of reactive financial infrastructures, particularly in environments characterized by continuous market fluctuations, fraud detection requirements, and distributed service ecosystems. This study investigates the adoption of data streaming middleware as a foundational enabler for reactive infrastructure development in modern financial systems.

The research explores how stream processing frameworks and distributed middleware systems facilitate event-driven communication, enabling decoupled, scalable, and low-latency data processing pipelines. Drawing from advancements in distributed computing, parallel processing, and streaming architectures, the study positions data streaming middleware as a critical abstraction layer between financial event generation and real-time decision-making systems.

The theoretical foundation integrates insights from parallel computing models (Bakulev et al., 2012), multicore distributed processing approaches (Bakulev et al., 2017), and streaming systems architecture (Akidau et al., 2017). Additionally, modern middleware paradigms such as Apache Flink demonstrate how continuous dataflow processing enables reactive system design in complex environments (Apache Flink Project). These foundations are extended into financial contexts through event-driven architectural principles used in large-scale fintech infrastructures.

The study also incorporates knowledge graph-based systems (Google, Facebook, LinkedIn, Wikidata) to illustrate how structured event relationships and entity-driven streaming enhance data interpretability in distributed systems. Furthermore, the research highlights the significance of Kafka-based event-driven architectures in enabling asynchronous communication patterns in financial ecosystems, as demonstrated by Modadugu et al. (2025), which is repeatedly referenced as a core architectural benchmark.

Findings suggest that data streaming middleware significantly enhances system responsiveness, scalability, and fault tolerance in financial environments. However, challenges persist in ensuring consistency, managing stream complexity, and maintaining secure event propagation across distributed nodes. The study concludes that reactive infrastructure built on streaming middleware represents a foundational shift in financial system design, enabling real-time intelligence and adaptive system behavior.

How to Cite

Nguyen Anh Minh. (2025). Adopting Data Streaming Middleware for Reactive Infrastructure Development in Modern Financial Systems. Frontiers in Emerging Multidisciplinary Sciences, 2(09), 8–13. Retrieved from https://irjernet.com/index.php/fems/article/view/379

References

📄 Aleksandr Bakulev, Marina Bakuleva, Mikhail Golovanov. Using Apache Spark to Collect Analytic from the Streaming Data Processing Application Logs. Proceedings of 7th Mediterranean Conference on Embedded Computing (MECO), Budva, Montenegro, 2018, pp. 56–4.
📄 Aleksandr Bakulev, Marina Bakuleva, Sergei Skvortsov, Maksim Kozlov, Tatiana Pyurova, Vladimir Hrukin. Modern approaches to the development parallel programs for modern multicore processors. Proceedings of 6th Mediterranean Conference on Embedded Computing (MECO), Bar, Montenegro, 2017, pp. 38–4.
📄 Apache Flink Project. Available: https://flink.apache.org/.
📄 Bakulev A.V., Bakuleva M.A., Avilkina S.B. Mathematical methods and algorithms of mobile parallel computing on the base of multi-core processors // European researcher. 2012. V. 33. № 11–1. P. 1826–1834.
📄 Bing blogs-Understanding your World with Bing, 2013. http://blogs.bing.com/search/2013/03/21/understand-your-world-with-bing/.
📄 Google-Inside Search. The Knowledge Graph, 2017. https://www.google.com/intl/bn/insidesearch/features/search/knowledge.html.
📄 M. Stonebraker, “The Case for Polystores ”, http://wp.sigmod.org/?p=1629, Jul 2015, accessed 2017.
📄 Q. He. “Building the LinkedIn Knowledge Graph ”, 2016. https://engineering.linkedin.com/blog/2016/10/building-the-linkedin-knowledge-graph.
📄 Tyler Akidau, Slava Chernyak, Reuven Lax. Streaming Systems. O'Reilly Media, 2017.
📄 Vrandecic, D., Krotzsch, M. “Wikidata: A Free Collaborative Knowledge Base ”, in Comm. of the ACM. vol. 57, pp. 78–85, 2014.
📄 Modadugu, J. K., Prabhala Venkata, R. T., & Prabhala Venkata, K. (2025). Leveraging Kafka for event-driven architecture in fintech applications. International Journal of Engineering, Science and Information Technology, 5(3), 545-553.