Research on Data Quality Improvement Program Based on Big Data Application

Research on Data Quality Improvement Program Based on Big Data Application

연구 분야: Databases

학회: 2023 IEEE 3rd International Conference on Information Technology, Big Data and Artificial Intelligence (ICIBA)

In the rapidly developing information age, the explosive growth of data increases the difficulty of big data application. Through analyzing the challenges faced by big data applications such as data collection, data timeliness, data security, data quality and data expected results, based on the key characteristics of big data and the measurement indicators of data quality, the improvement procedures of data quality are proposed, that is, following the pre-processing stage, the quality measurement stage, the quality defect identification stage and the pre-processing work tracing stage, in addition, the effect of the data quality improvement procedure is evaluated, to improve the data quality and reduce the potential risks in the application process of big data.