A novel solution to perform real-time ETL process based on non-intrusive and reactive concepts

A novel solution to perform real-time ETL process based on non-intrusive and reactive concepts

연구 분야: Databases

학회: 2021 International Conference on Computational Science and Computational Intelligence (CSCI)

ETL is an essential process required to perform data extraction in data warehousing environments. The ETL process aims to gather data that is available from data sources, process and store them into an integrated data repository. Also, the ETL process can be performed in a real-time way. This paper presents a novel solution, called Data Magnet, to real-time ETL process based on non-intrusive and reactive concepts. The Data Magnet was validated using synthetic data. The results showed the correctness of the Data Magnet and the attendance of real-time requirements.