A Microservices Based Architecture for Implementing and Automating ETL Data Pipelines for Mobile Crowdsensing Applications

A Microservices Based Architecture for Implementing and Automating ETL Data Pipelines for Mobile Crowdsensing Applications

연구 분야: Databases

학회: 2021 IEEE International Conference on Big Data (Big Data)

Mobile crowdsensing (MCS) has emerged as a new revolutionary paradigm to collect large-scale data by the crowd. However, there is a lack of a holistic system than can provide an integrated design for this large volumes data coming from different sensors, and afford analytics capabilities. This paper provides an envision of a micro-service based architecture for implementing and automating ETL data management pipelines in MCS.