Cost-Efficient Cross-Region Copy in Cloud Data Warehouse: An Evolutionary Approach

Cost-Efficient Cross-Region Copy in Cloud Data Warehouse: An Evolutionary Approach

연구 분야: Databases

학회: 2023 IEEE International Conference on Big Data (BigData)

The “CRC” service optimizes cross-region data copying for enhanced cost efficiency, progressing through three distinctive phases. During phase 1, an essential pipeline is established to fulfill functional prerequisites while ensuring robust security standards. In phase 2, cost-efficiency is amplified by decreasing execution frequency, a strategy encompassing subphases: a) exclusion of unaltered tables, b) deferred scheduling facilitated by modification timestamp logging, and c) projection of execution durations to guarantee data timeliness. In phase 3, the spotlight shifts to minimizing scanned data for partitioned tables, leveraging phase 2’s algorithmic expansion from tables to partitions. Evaluation results underscore the service’s tangible impact, displaying significant cost reduction across frequently accessed datasets.