UnionFS

From HandWiki
Short description: A filesystem service for Linux
Unionfs
Developer(s)Open Source Community
Full nameUnification File System
Features
File system permissionsPOSIX
Transparent compressionNo
Transparent encryptionNo (but can be provided at the block device level)
Other
Supported operating systemsLinux, FreeBSD and NetBSD

Unionfs is a filesystem service for Linux, FreeBSD and NetBSD which implements a union mount for other file systems. It allows files and directories of separate file systems, known as branches, to be transparently overlaid, forming a single coherent file system. Contents of directories which have the same path within the merged branches will be seen together in a single merged directory, within the new, virtual filesystem.

When mounting branches, the priority of one branch over the other is specified. So when both branches contain a file with the same name, one gets priority over the other.

The different branches may be either read-only or read/write file systems, so that writes to the virtual, merged copy are directed to a specific real file system. This allows a file system to appear as writable, but without actually allowing writes to change the file system, also known as copy-on-write. This may be desirable when the media is physically read-only, such as in the case of Live CDs.

Unionfs was originally developed by Erez Zadok and his team at Stony Brook University.[1][2][3]

Uses

In Knoppix, a union between the file system on the CD-ROM or DVD and a file system contained in an image file called knoppix.img (knoppix-data.img for Knoppix 7) on a writable drive (such as a USB memory stick) can be made, where the writable drive has priority over the read-only filesystem. This allows the user to change any of the files on the system, with the new file stored in the image and transparently used instead of the one on the CD.[4]

Unionfs can also be used to create a single common template for a number of file systems, or for security reasons. It is sometimes used as an ad hoc snapshotting system.

Docker uses file systems inspired by Unionfs, such as Aufs, to layer Docker images. As actions are done to a base image, layers are created and documented, such that each layer fully describes how to recreate an action. This strategy enables Docker's lightweight images, as only layer updates need to be propagated (compared to full VMs, for example).[5]

UbuntuLTSP, the Linux Terminal Server Project implementation for Ubuntu, uses Unionfs when PXE booting thin or thick clients.[6]

Other implementations

Unionfs for Linux has two versions. Version 1.x is a standalone one that can be built as a module. Version 2.x is a newer, redesigned, and reimplemented one.

aufs is an alternative version of unionfs.[7]

overlayfs written by Miklos Szeredi has been used in OpenWRT and considered by Ubuntu and has been merged into the mainline Linux kernel on 26 October 2014[8] after many years of development and discussion[9] for version 3.18 of the kernel.

unionfs-fuse is an independent project, implemented as a user space filesystem program, instead of a kernel module or patch. Like Unionfs, it supports copy-on-write and read-only or read–write branches.[10]

The Plan 9 from Bell Labs operating system uses union mounts extensively to build custom namespaces per user or processes.

Union mounts have also been available in BSD since at least 1995.[11]

The GNU Hurd has an implementation of Unionfs.[12] As of January 2008, it works, but results in a read-only mount-point.

mhddfs works like Unionfs but permits balancing files over drives with the most free space available. It is implemented as a user space filesystem.

mergerfs is a FUSE based union filesystem which offers multiple policies for accessing and writing files as well as other advanced features (xattrs, managing mixed RO and RW drives, link CoW, etc.).[13]

Sun Microsystems introduced the first implementation of a stacked, layered file system with copy-on-write, whiteouts (hiding files in lower layers from higher layers), etc. as the Translucent File Service in SunOS 3, circa 1986.[14]

JailbreakMe 3.0, a tool for jailbreaking iOS devices released in July 2011, uses unionfs techniques to speed up the installation process of the operating system modification.[15]

See also

References

  1. Wright, Charles P.; Zadok, Erez (December 2004). "Kernel Korner: Unionfs: Bringing Filesystems Together". Linux Journal 2004 (128): 8. ISSN 1075-3583. https://dl.acm.org/citation.cfm?id=1044970.1044978. 
  2. "Git server of File systems and Storage Lab". Stony Brook University. http://git.fsl.cs.sunysb.edu/. "Project: unionfs-3.9.y.git; Owner: Erez Zadok" 
  3. "File systems and Storage Lab: CS Department". Stony Brook University. http://www.fsl.cs.sunysb.edu/. "Lab Coordinator and Principal Investigator: Prof. Erez Zadok" 
  4. Schulz, Werner P. (2016-12-15). "Hard drive Installation: UNIONFS". Knoppix. http://knoppix.net/wiki/Category:Hard_drive_Installation#UNIONFS. 
  5. "Docker overview: Union file systems". Docker, Inc.. 2017-07-13. https://docs.docker.com/engine/docker-overview/#union-file-systems. 
  6. Georgopoulos, Alkis (2010-12-24). "UbuntuLTSP/LTSPWithoutNFS". https://help.ubuntu.com/community/UbuntuLTSP/LTSPWithoutNFS. 
  7. "aufs Homepage". 2017-07-02. http://aufs.sourceforge.net. 
  8. Torvalds, Linus (2014-10-26). "overlayfs merge + leak fix for d_splice_alias() failure exits". https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=d1e14f1d63eb15ebe97d1a8544ddc143486b0204. 
  9. Corbet, Jonathan (2011-06-15). "Debating overlayfs". https://lwn.net/Articles/447650/. 
  10. Podgorny, Radek (2016-11-21). "unionfs-fuse – A userspace unionfs implementation". https://github.com/rpodgorny/unionfs-fuse/blob/master/man/unionfs.8. 
  11. Pendry, Jan-Simon; McKusick, Marshall Kirk (January 1995). "Union Mounts in 4.4BSD-Lite". USENIX 1995 Technical Conference Proceedings. https://www.usenix.org/legacy/publications/library/proceedings/neworl/mckusick.html. 
  12. Schwinge, Thomas (2014-02-26). "unionfs". GNU Hurd. https://www.gnu.org/software/hurd/hurd/translator/unionfs.html. 
  13. "trapexit/mergerfs" (in en). https://github.com/trapexit/mergerfs. 
  14. Sun/Release 3.0. 1. Interleaf Technical Publishing. 1988. pp. 15‑1–18, 16‑1–19. 
  15. Imran, Awais (2011-06-19). "Comex Working on Faster Jailbreaking Process for JailbreakMe 3.0; iPad 2 Jailbreak Coming Soon!". Redmond Pie. http://www.redmondpie.com/comex-working-on-faster-jailbreaking-process-for-jailbreakme-3.0-ipad-2-jailbreak-coming-soon/. 

External links