Data Factory: An Efficient Data Analysis Solution in the Era of Big Data

Data Factory: An Efficient Data Analysis Solution in the Era of Big Data

연구 분야: Databases

학회: 2020 5th IEEE International Conference on Big Data Analytics (ICBDA)

For each industry in the era of big data, a steady stream of data is generated continually. Due to the enormous information contained in big data, how to maximally extract the value from big data with lower cost to provide decision-making, guide production and resource allocation for the enterprises has attracted more and more attention of most enterprises. This paper proposes a data analysis solution in the era of big data–data factory, and implements a software system to build a data factory for an enterprise promptly and efficiently. By processing, analyzing and modeling the data in a workshop-based production mode similar to the traditional factories using raw materials, our data factory will acquire the analysis results and prediction models and then realize the clustering, classification, evaluation, and prediction data analysis. Moreover, the application of deploying data factory for an enterprise reveals that data factory is an efficient solution for big data analysis, and it improves the efficiency of enterprise data analysis.