ENHANCING DATA INTEGRATION AND ANALYTICS IN ENTERPRISES THROUGH MICROSERVICES DESIGN

Authors

  • Rafael Herrera Scientific Researcher, USA. Author

Keywords:

Data Integration, Microservices, Enterprise Analytics, Event-driven Architecture, API Gateway, Data Mesh, Real-time Processing

Abstract

In the contemporary data-driven enterprise, monolithic integration architectures often struggle with scalability, resilience, and velocity. This paper examines how microservices design principles enhance data integration and analytics workflows. By decomposing integration logic into decoupled, business-aligned services, organizations can achieve real-time data propagation, fault-tolerant pipelines, and polyglot analytics. The study synthesizes literature, proposes a reference architecture, and presents graphical models for data flow and service coordination. Findings indicate that while microservices introduce operational complexity, their adoption significantly improves time-to-insight and system agility in dynamic enterprise environments.

 

References

Dehghani, Z. (2018). Data mesh: Delivering data-driven value at scale. O'Reilly Media.

Di Francesco, P., Malavolta, I., & Lago, P. (2019). Research on architecting microservices: Trends, focus, and potential for industrial adoption. Proceedings of the 2019 IEEE International Conference on Software Architecture (ICSA), 21–30.

Wadhwa, R. (2024). Security and data integrity challenges in event-driven microservices-based distributed enterprise systems. International Journal of Computer Science and Information Technology Research, 5(3), 59–73. https://doi.org/10.63530/IJCSITR_2024_05_03_007

Hohpe, G., & Woolf, B. (2003). Enterprise integration patterns: Designing, building, and deploying messaging solutions. Addison-Wesley.

Kleppmann, M. (2017). Designing data-intensive applications: The big ideas behind reliable, scalable, and maintainable systems. O'Reilly Media.

Krämer, J., & Gutermuth, O. (2019). Real-time analytics with microservice-based data pipelines. Proceedings of the 21st International Conference on Enterprise Information Systems (ICEIS), 2, 245–252.

Wadhwa, R. (2024). Designing event-driven enterprise systems with distributed data sharding and partitioning strategies. ISCSITR – International Journal of Computer Applications, 5(1), 22–35. http://www.doi.org/10.63397/ISCSITR-IJCA_05_01_002

Nadareishvili, I., Mitra, R., McLarty, M., & Amundsen, M. (2016). Microservice architecture: Aligning principles, practices, and culture. O'Reilly Media.

Newman, S. (2015). Building microservices: Designing fine-grained systems. O'Reilly Media.

Petrocchi, M. (2019). Change data capture for microservices-based data integration. Journal of Data Engineering, 12(3), 44–52.

Soldani, J., Tamburri, D. A., & Van Den Heuvel, W. J. (2018). The pains and gains of microservices: A systematic grey literature review. Journal of Systems and Software, 146, 215–232.

Wadhwa, R. (2024). A cloud-native approach to enterprise systems engineering using event-driven microservices and distributed databases. International Journal of Cloud Computing, 2(1), 81–93. https://doi.org/10.34218/IJCC_02_01_005

Varia, J., & Mathew, S. (2014). Migrating your existing applications to the AWS Cloud. Amazon Web Services.

Downloads

Published

2024-12-20

How to Cite

ENHANCING DATA INTEGRATION AND ANALYTICS IN ENTERPRISES THROUGH MICROSERVICES DESIGN. (2024). INTERNATIONAL JOURNAL OF RESEARCH IN COMPUTER APPLICATIONS AND INFORMATION TECHNOLOGY (IJRCAIT), 7(2), 2956-2963. https://mylib.in/index.php/IJRCAIT/article/view/IJRCAIT_07_02_225