Enhancing Big Data Conversion Validation with Alpha-Lightweight Coreset

Enhancing Big Data Conversion Validation with Alpha-Lightweight Coreset

연구 분야: Databases

학회: SN Computer Science

In this paper, we apply a previously proposed data conversion system that leverages the -lightweight coreset for efficient and accurate validation in the context of big data. The system is designed to migrate data from MySQL to MongoDB while preserving consistency across columns, rows, and data types. We focus on the validation process, which employs the -lightweight coreset to identify errors in the transformed data quickly and with high accuracy. We investigate the optimal value of for various scenarios by comparing different values from 0 to 1. Our experimental results demonstrate that the value around 3/4 generally provides optimal performance. However, for datasets requiring more focus on the additive error, the optimal value may differ. This study highlights the effectiveness of the -lightweight coreset in improving the speed and accuracy of the validation process in data conversion systems for big data.