Construction of Video Resources Data Warehouse System Based on Hive

Construction of Video Resources Data Warehouse System Based on Hive

연구 분야: Databases

학회: 2023 International Conference on Data Science and Network Security (ICDSNS)

With the continuous development of computer technology and the Internet, as well as the arrival of 5G era, the rapid growth of data, data warehouse has played a huge role in various practical applications. Massive English video teaching resources promote English teaching. How to manage these resources effectively becomes a difficult problem. A data warehouse system of English video resources is built based on Hive to convert various English video resources and eventually form a data set. Firstly, the Hive data warehouse tool is studied. Then, the compression coding of H.266/VVC video is studied, including intra-frame prediction, transform coding and quality evaluation. Finally, the video resource migration based on Sqoop tool is studied. The research results significantly enhance the compression performance of encoders, and have the advantages of low cost, high performance and high fault tolerance in modern data warehouse.