Research on Improved Method of Storage and Query of Large-Scale Remote Sensing Images
The traditional method is used to deal with massive remote sensing data stored in low efficiency and poor scalability. This article presents a parallel processing method based on MapReduce and HBase. The filling of remote sensing images by the Hilbert curve makes the MapReduce method construct pyramids in parallel to reduce network communication between nodes. Then, the authors design a massive remote sensing data storage model composed of metadata storage model, index structure and filter column family. Finally, this article uses MapReduce frameworks to realize pyramid construction, storage and query of remote sensing data. The experimental results show that this method can effectively improve the speed of data writing and querying, and has good scalability.
Year of publication: |
2018
|
---|---|
Authors: | Weipeng, Jing ; Dongxue, Tian ; Guangsheng, Chen ; Yiyuan, Li |
Published in: |
Journal of Database Management (JDM). - IGI Global, ISSN 1533-8010, ZDB-ID 2070075-1. - Vol. 29.2018, 3 (01.07.), p. 1-16
|
Publisher: |
IGI Global |
Subject: | Data Query | Distribute Storage | HBase | MapReduce | Pyramid | Remote Data |
Saved in:
Online Resource
Saved in favorites
Similar items by subject
-
An Intelligent Approval System for City Construction based on Cloud Computing and Big Data
Chen, Guanlin, (2016)
-
Analysis of Grievances in the Banking Sector through Big Data
Bhatnagar, Vishal, (2016)
-
Module-based quality system functionality evaluation in production logistics
Khabbazi, Mahmood Reza, (2016)
- More ...
Similar items by person