Architecture and mechanisms of Hadoop distributed file system

Abstract

The architecture, function and mechanisms of Hadoop distributed file system (HDFS) were discussed, with the advantages and disadvantages of the system analyzed. A HDFS-based higher reliability and more saving memory space file system was proposed. REPERA not only saves memory space, but also improves renew ability of damaged date by combining backup and erasure codes. When all backup of some or other date block are broken, REPERA can automatically renew the broken date block by using appropriate encoding and decoding scheme.