Software:XtreemFS

From HandWiki
Short description: Distributed file system
XtreemFS
XtreemFS Logo.jpg
Stable release
1.5.1 / March 12, 2015 (2015-03-12)
Written inJava
Operating systemLinux, Windows, Mac OS X
TypeDistributed file system
LicenseNew BSD
Websitewww.xtreemfs.org

XtreemFS is an object-based, distributed file system for wide area networks.[1] XtreemFS' outstanding feature is full (all components) and real (all failure scenarios, including network partitions) fault tolerance, while maintaining POSIX file system semantics. Fault-tolerance is achieved by using Paxos-based lease negotiation algorithms and is used to replicate files and metadata. SSL and X.509 certificates support make XtreemFS usable over public networks.

XtreemFS has been under development since early 2007. A first public release was made in August 2008. XtreemFS 1.0 was released in August 2009. The 1.0 release includes support for read-only replication with failover, data center replica maps, parallel reads and writes, and a native Windows client. The 1.1 added automatic on-close replication and POSIX advisory locks. In mid-2011, release 1.3 added read/write replication for files. Version 1.4 underwent extensive testing and is considered production-quality. An improved Hadoop integration and support for SSDs was added in version 1.5.

XtreemFS is funded by the European Commission's IST programme.

The original XtreemFS team founded Quobyte Inc. in 2013. Quobyte offers a professional storage system as a commercial product.

Features

  • Secure connections to Contrail[2]
  • Clients for Linux, Windows and OS X
  • Open source (New BSD License since release 1.3)
  • Cross-site file replication with auto-failover
  • Partial replicas, objects fetched on demand
  • POSIX compatibility
  • Plugins for authentication policies, replica selection
  • RAID0 (striping) with parallel I/O over stripes[3]
  • Read-only replication
  • Security (SSL, X.509 certificates)
  • Servers for Linux and Solaris Natively and Non-Native Windows Java & ANT based server.
  • experimental file system driver for Hadoop (added in version 1.2)

Use cases

  • as a filer replacement (home directories and group shares),
  • in HPC cluster,
  • in Hadoop clusters,
  • for VM block storage
  • cross-branch data sharing
  • and many more use cases, all in a single system.

See also

References

  1. F. Hupfeld, T. Cortes, B. Kolbeck, E. Focht, M. Hess, J. Malo, J. Marti, J. Stender, E. Cesario. "XtreemFS - a case for object-based storage in Grid data management". VLDB Workshop on Data Management in Grids. In: Proceedings of 33rd International Conference on Very Large Data Bases (VLDB) Workshops, 2007.
  2. Versweyveld, Leslie (30 October 2012). "The Contrail project is proud to present its first complete set of interoperable Cloud federation tools". http://www.isgtw.org/announcement/contrail-project-proud-present-its-first-complete-set-interoperable-cloud-federation-to.  Alt URL[yes|permanent dead link|dead link}}]
  3. J. Stender, B. Kolbeck, F. Hupfeld, E. Cesario, E. Focht, M. Hess, J. Malo, J. Marti. "Striping without Sacrifices: Maintaining POSIX Semantics in a Parallel File System". 1st USENIX Workshop on Large-Scale Computing (LASCO '08), Boston, 2008

External links