ChainSync: A Real-Time Multi-chain ETL System for dApp Development

ChainSync: A Real-Time Multi-chain ETL System for dApp Development

연구 분야: Databases

학회: International Conference on Database Systems for Advanced Applications

The increasing number of public blockchains has led to a need for infrastructures and tools for decentralized application (dApp) development. The blockchain Extract-Transform-Load (ETL) process, which involves extracting on-chain data, converting it into the desired format, and loading it into data stores, is essential for most dApp development. However, many blockchains lack blockchain ETL tools or frameworks, and building a blockchain ETL for each blockchain is complicated. To overcome this problem, we propose a multi-chain ETL system featuring (1) an ETL pipeline that can be easily extended to support multiple blockchains, (2) data stores optimized for dApp development, and (3) an event-based pub-sub system for dApps to consume real-time on-chain data. The proposed framework has been integrated with multiple blockchains and supports multiple dApps in production environments.