Software:List of log-structured file systems

From HandWiki
Short description: none

This is an incomplete list of log-structured file system implementations.

  • James T, Brady while in IBM Poughkeepsie Lab conceived a log structured paging file system in 1979 which was implemented in MVS SP2 in 1980.[1][2]
  • John K. Ousterhout and Mendel Rosenblum implemented the first log-structured file system for the Sprite operating system in 1992.[3][4]
  • BSD-LFS, an implementation by Margo Seltzer was added to 4.4BSD, and was later ported to 386BSD. It lacked support for snapshots. It was removed from FreeBSD and OpenBSD, but still lives on in NetBSD.
  • Plan 9's Fossil file system is also log-structured and supports snapshots.
  • NILFS is a log-structured file system implementation for Linux by NTT/Verio which supports snapshots.
  • LinLogFS (formerly dtfs) and LFS are log-structured file system implementations for Linux. The latter was part of Google Summer of Code 2005. Both projects have been abandoned.
  • LFS is another log-structured file system for Linux developed by Charles University, Prague. It was to include support for snapshots and indexed directories, but development has since ceased.
  • Write Anywhere File Layout (WAFL) by NetApp is a file layout that supports large, high-performance RAID arrays, quick restarts without lengthy consistency checks in the event of a crash or power failure, and growing the filesystems size quickly. Built using log-structured file system concept,[citation needed] snapshots and off-line data deduplication.
  • LSFS is a log-structured file system with writable snapshots and inline data deduplication created by StarWind Software.[5]
  • Cache Accelerated Sequential Layout (CASL) is a proprietary log-structured filesystem developed by Nimble Storage that uses Solid State Devices to cache traditional hard drives.[6]
  • ObjectiveFS is a log-structured FUSE filesystem that uses cloud object stores (e.g. Amazon S3, Google Cloud Storage and private cloud object store).
  • NOVA for byte-addressable persistent memory (for example non-volatile dual in-line memory module (NVDIMM) and 3D XPoint) for Linux developed at the University of California, San Diego, US.[7]
  • Spiralog was a log-structured filesystem created by Digital Equipment Corporation for the OpenVMS operating system.[8] Spiralog was an optional product, and was discontinued due to a variety of problems, including issues with handling full volumes.[9]

Some kinds of storage media, such as flash memory and CD-RW, slowly degrade as they are written to and have a limited number of erase/write cycles at any one location. Log-structured file systems are sometimes used on these media because they make fewer in-place writes and thus prolong the life of the device by wear leveling. The more common such file systems include:

  • UDF is a file system commonly used on optical discs.
  • JFFS and its successor JFFS2 are simple Linux file systems intended for raw flash-based devices.
  • UBIFS is a filesystem for raw NAND flash media and also intended to replace JFFS2.
  • LogFS is a scalable flash filesystem for Linux that works on both raw flash media and block devices, intended to replace JFFS2.
  • YAFFS is a raw NAND flash-specific file system for many operating systems (including Linux).
  • F2FS is a new file system designed for the NAND flash memory-based storage devices on Linux.

See also

References

  1. Samson, Stephen L.. MVS Performance Management OS/390 Edition. p. 12. 
  2. "1981 IBM Corporate Technical Recognition Event Book, Outstanding Innovation Award, “Virtual Storage Disk Paging”"
  3. Rosenblum, Mendel and Ousterhout, John K. (June 1990) - "The LFS Storage Manager". Proceedings of the 1990 Summer Usenix. pp315-324.
  4. Rosenblum, Mendel and Ousterhout, John K. (February 1992) - "The Design and Implementation of a Log-Structured File System". ACM Transactions on Computer Systems, Vol. 10 Issue 1. pp26-52.
  5. Toigo, Jon William (5 March 2015). "The struggle between virtual machine performance and storage". https://searchstorage.techtarget.com/opinion/The-struggle-between-virtual-machine-performance-and-storage. 
  6. Shanks, Eric (November 25, 2013). "CASL with Nimble Storage". http://theithollow.com/2013/11/25/casl-nimble-storage/. 
  7. "The NOVA filesystem [LWN.net"]. https://lwn.net/Articles/729812/. 
  8. James E. Johnson; William A. Laing (1996). "Spiralog Log-Structured File System". Digital Technical Journal 8 (2). http://www.dtjcd.vmsresource.org.uk/pdfs/dtj_v08-02_1996.pdf. 
  9. "Why was Spiralog retired?". 2006-01-10. https://community.hpe.com/t5/Operating-System-OpenVMS/Why-was-Spiralog-retired/td-p/4951205.