Software:NEC HYDRAstor

From HandWiki
NEC HYDRAstor
Stable release
HS8-5000 / 2016
Written inC++
PlatformCross-platform
TypeBackup and Archive
Licenseproprietary
Websitewww.necam.com/hydrastor/

NEC HYDRAstor is a disk-based grid storage system with data deduplication for backups and archiving, developed by NEC Corporation. A HYDRAstor storage system can be composed of multiple nodes, starting from one up to 100+ nodes. Each node contains standard hardware including disk drives, CPU, memory and network interfaces and is integrated with the HYDRAstor software into a single storage pool. HYDRAstor software incorporates multiple features of distributed storage systems: content-addressable storage, global data deduplication, variable block size, Rabin fingerprinting, erasure codes, data encryption and load balancing.

History

HYDRAstor project was started in 2002 by Cezary Dubnicki and Cristian Ungureanu in NEC Research in Princeton, NJ.[citation needed] Prototype version was implemented and evaluated in 2004.[1] After another 3 years of development, first version of HYDRAstor was brought to the market in US and Japan. Subsequent version with improved software and hardware were released in following years, with latest version, HS8-5000, providing 72TB raw storage per node, up to 11.88PB of raw capacity in its maximum configuration.[2]

Main features

HYDRAstor can be scaled from single node to 165 nodes in a multi-rack grid appliance.[3] Capacity and bandwidth can be scaled independently by using different types of nodes:

  • storage nodes – adding capacity
  • hybrid nodes – adding both capacity and performance

HYDRAstor supports online expansion, with automatic data migration and with no downtime.[4] In standard configuration, HYDRAstor provides resiliency to up to 3 concurrent disk or node failures.[5] Failures are automatically detected and data reconstruction is automatically performed, which means that if time between failures is enough to reconstruct data, system can withstand any number of them.[4]

References

  1. Cezary Dubnicki; Cristian Ungureanu; Wojciech Kilian (2004). "Proceedings. 13th IEEE International Symposium on High performance Distributed Computing, 2004". 13th IEEE International Symposium on High performance Distributed Computing (HPDC '04). IEEE. pp. 120–128. doi:10.1109/HPDC.2004.1323509. ISBN 0-7695-2175-4. 
  2. "HYDRAstor HS8-5000: Scale-out Global Dedupliaction Storage for Backup and Archive". NEC America. https://www.necam.com/Docs/?id=dcb67490-2973-443a-b81c-13c6600f4627. 
  3. "HYDRAstor HS8-5000: Scale-out Global Dedupliaction Storage for Backup and Archive". NEC America. https://www.necam.com/Docs/?id=dcb67490-2973-443a-b81c-13c6600f4627. 
  4. 4.0 4.1 Cezary Dubnicki; Leszek Gryz; Łukasz Heldt; Michał Kaczmarczyk; Wojciech Kilian; Przemysław Strzelczak; Jerzy Szczepkowski; Cristian Ungureanu et al. (February 24–27, 2009). "HYDRAstor: a Scalable Secondary Storage". San Francisco, California: USENIX. https://www.usenix.org/legacy/event/fast09/tech/full_papers/dubnicki/dubnicki_html/strzelczak_html.html. Retrieved 2015-04-29. 
  5. "HYDRAstor - FAQ". NEC America. https://www.necam.com/HYDRAstor/doc.cfm?t=FAQs.