Extended file attributes

From HandWiki

Extended file attributes are file system features that enable users to associate computer files with metadata not interpreted by the filesystem, whereas regular attributes have a purpose strictly defined by the filesystem (such as permissions or records of creation and modification times). Unlike forks, which can usually be as large as the maximum file size, extended attributes are usually limited in size to a value significantly smaller than the maximum file size. Typical uses include storing the author of a document, the character encoding of a plain-text document, or a checksum, cryptographic hash or digital certificate, and discretionary access control information. In Unix-like systems, extended attributes are usually abbreviated as xattr.[1]

Implementations

AIX

In AIX, the JFS2 v2 filesystem supports extended attributes, which are accessible using the getea command.[2] The getea,[3] setea,[4] listea,[5] statea,[6] and removeea[7] APIs support fetching, setting, listing, getting information about, and removing extended attributes.

BeOS/Haiku

In the now-defunct BeOS and successors like Haiku, extended file attributes are widely used in base and third-party programs. The Be File System allows the indexing and querying of attributes, essentially giving the filesystem database-like characteristics. The uses of extended attributes in Be-like systems are varied: For example, Tracker and OpenTracker, the file-managers of BeOS and Haiku respectively, both store the locations of file icons in attributes,[8] Haiku's "Mail" service stores all message content and metadata in extended file attributes,[9] and the MIME types of files are stored in their attributes. Extended file attributes can be viewed and edited in Be-like systems' GUI through the file-manager, often Tracker or derivatives thereof.

FreeBSD

In FreeBSD 5.0 and later, the UFS1, UFS2, and ZFS filesystems support extended attributes, using the extattr_[10] family of system calls. Any regular file may have a list of extended attributes. Each attribute consists of a name and the associated data. The name must be a null-terminated string, and exists in a namespace identified by a small-integer namespace identifier. Currently, two namespaces exist: user and system. The user namespace has no restrictions with regard to naming or contents. The system namespace is primarily used by the kernel for access control lists and mandatory access control.

Linux

In Linux, the ext2, ext3, ext4, JFS, Squashfs, UBIFS, Yaffs2, ReiserFS, Reiser4, XFS, Btrfs, OrangeFS, Lustre, OCFS2 1.6, ZFS, and F2FS[11] filesystems support extended attributes (abbreviated xattr) when enabled in the kernel configuration. Any regular file or directory may have extended attributes consisting of a name and associated data. The name must be a null-terminated string prefixed by a namespace identifier and a dot character. Currently, four namespaces exist: user, trusted, security and system. The user namespace has no restrictions with regard to naming or contents. The system namespace is primarily used by the kernel for access control lists. The security namespace is used by SELinux, for example.

Support for the extended attribute concept from a POSIX.1e draft[citation needed] that had been withdrawn[12] in 1997 was added to Linux around 2002.[13][14] As of 2016, they are not yet in widespread use by user-space Linux programs, but are used by Beagle, OpenStack Swift, Dropbox, KDE's semantic metadata framework (Baloo), Chromium, Wget and cURL.

The Linux kernel allows extended attribute to have names of up to 255 bytes and values of up to 64 KiB,[15] as do XFS and ReiserFS, but ext2/3/4 and btrfs impose much smaller limits, requiring all the attributes (names and values) of one file to fit in one "filesystem block" (usually 4 KiB). Per POSIX.1e,[citation needed] the names are required to start with one of security, system, trusted, and user plus a period. This defines the four namespaces of extended attributes.[16]

Extended attributes can be accessed and modified using the getfattr and setfattr commands from the attr package on most distributions.[17] The APIs are called getxattr and setxattr.

macOS

Mac OS X 10.4 and later support extended attributes by making use of the HFS+ filesystem Attributes File B*-tree feature which allows for named forks. Although the named forks in HFS+ support arbitrarily large amounts of data through extents, the OS support for extended attributes only supports inline attributes, limiting their size to that which can fit within a single B*-tree node.[citation needed] Any regular file may have a list of extended attributes. HFS+ supports an arbitrary number of named forks, and it is unknown if macOS imposes any limit on the number of extended attributes.

Each attribute consists of a name and the associated data. The name is a null-terminated Unicode string. No namespace restrictions are present (making this an open xattr system) and the convention is to use a reverse DNS string (similar to Uniform Type Identifiers) as the attribute name.

macOS supports listing,[18] getting,[19] setting,[20] and removing[21] extended attributes from files or directories using a Linux-like API. From the command line, these abilities are exposed through the xattr utility.[22]

Since macOS 10.5, files originating from the web are marked with com.apple.quarantine via extended file attributes.[23] In some older versions of macOS (such as Mac OS X 10.6), user space extended attributes were not preserved on save in common Cocoa applications (TextEdit, Preview etc.).[citation needed]

OpenBSD

Support for extended file attributes was removed from the OpenBSD source code in 2005 due to a lack of interest in Access Control Lists.[24]

OS/2

In OS/2 version 1.2 and later, the High Performance File System was designed with extended attributes in mind, but support for them was also retro-fitted on the FAT filesystem of DOS. For compatibility with other operating systems using a FAT partition, OS/2 attributes are stored inside a single file "EA DATA. SF" located in the root directory. This file is normally inaccessible when an operating system supporting extended attributes manages the disk, but can be freely manipulated under, for example, DOS. Files and directories having extended attributes use one or more clusters inside this file. The logical cluster number of the first used cluster is stored inside the owning file's or directory's directory entry.[25] These two bytes are used for other purposes on the FAT32 filesystem, and hence OS/2 extended attributes cannot be stored on this filesystem.

Parts of OS/2 version 2.0 and later such as the Workplace Shell uses several standardized extended attributes (also called EAs) for purposes like identifying the filetype, comments, computer icons and keywords about the file. Programs written in the interpreted language Rexx store an already parsed version of the code as an extended attribute, to allow faster execution.

Solaris

Solaris version 9 and later allows files to have "extended attributes", which are actually forks; the maximum size of an "extended attribute" is the same as the maximum size of a file, and they are read and written in the same fashion as files. Internally, they are actually stored and accessed like normal files, so their names cannot contain "/" characters[26] and their ownership and permissions can differ from those of the parent file.

Version 4 of the Network File System supports extended attributes in much the same way as Solaris.

Windows NT

On Windows NT, limited-length extended attributes are supported by FAT,[25] HPFS, and NTFS. This was implemented as part of the OS/2 subsystem. They are notably used by the NFS server of the Interix POSIX subsystem in order to implement Unix-like permissions. The Windows Subsystem for Linux added in the Windows 10 Anniversary Update uses them for similar purposes, storing the Linux file mode, owner, device ID (if applicable), and file times in the extended attributes.[27]

Additionally, NTFS can store arbitrary-length extended attributes in the form of alternate data streams (ADS), a type of resource fork. Plugins for the file manager Total Commander, like NTFS Descriptions and QuickSearch eXtended support filtering the file list by or searching for metadata contained in ADS.[28][29] NTFS-3G supports mapping ADS to extended attributes in FUSE; it also maps file attributes that way.[30]

See also

References

  1. ↑ xattr(7) – Linux Programmer's Manual – Overview, Conventions and Miscellanea
  2. ↑ "getea Command". IBM AIX V7.2 documentation. IBM. https://www.ibm.com/support/knowledgecenter/en/ssw_aix_72/com.ibm.aix.cmds2/getea.htm. 
  3. ↑ "getea Subroutine". IBM AIX V7.2 documentation: Base Operating System and Extensions, Volume 1. IBM. https://www.ibm.com/support/knowledgecenter/en/ssw_aix_72/com.ibm.aix.basetrf1/getea.htm. 
  4. ↑ "setea Subroutine". IBM AIX V7.2 documentation: Base Operating System and Extensions, Volume 2. IBM. https://www.ibm.com/support/knowledgecenter/en/ssw_aix_72/com.ibm.aix.basetrf2/setea.htm. 
  5. ↑ "listea Subroutine". IBM AIX V7.2 documentation: Base Operating System and Extensions, Volume 1. IBM. https://www.ibm.com/support/knowledgecenter/en/ssw_aix_72/com.ibm.aix.basetrf1/listea.htm. 
  6. ↑ "statea Subroutine". IBM AIX V7.2 documentation: Base Operating System and Extensions, Volume 2. IBM. https://www.ibm.com/support/knowledgecenter/en/ssw_aix_72/com.ibm.aix.basetrf2/statea.htm. 
  7. ↑ "removeea Subroutine". IBM AIX V7.2 documentation: Base Operating System and Extensions, Volume 2. IBM. https://www.ibm.com/support/knowledgecenter/en/ssw_aix_72/com.ibm.aix.basetrf2/removeea.htm. 
  8. ↑ "Attributes". Haiku, Inc.. https://www.haiku-os.org/docs/userguide/en/attributes.html. 
  9. ↑ "Workshop: Managing Emails". Haiku, Inc.. https://www.haiku-os.org/docs/userguide/en/workshop-email.html. 
  10. ↑ extattr(2) – FreeBSD System Calls Manual
  11. ↑ Kim, Jaegeuk (2012-10-05). "[PATCH 13/16 f2fs: add xattr and acl functionalities"]. http://lkml.iu.edu/hypermail/linux/kernel/1210.0/03190.html. 
  12. ↑ Schaufler, Casey (2002-04-30). "Posix.1e?". Newsgroup: comp.security.unix.
  13. ↑ "v2.5.3 git commit log". 2002-02-05. https://git.kernel.org/pub/scm/linux/kernel/git/tglx/history.git/commit/include/?id=1ea864f1c53bc771294e61cf9be43b1d22e78f4c. 
  14. ↑ "Red Hat Enterprise Linux AS 3 Release Notes (x86 Edition)". Red Hat. 2003. https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/3/html/Release_Notes/as-x86/index.html. "EA (Extended Attributes) and ACL (Access Control Lists) functionality is now available for ext3 file systems. In addition, ACL functionality is available for NFS." 
  15. ↑ "linux/include/uapi/linux/limits.h". 2012-10-13. https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/include/uapi/linux/limits.h?id=607ca46e97a1b6594b29647d98a32d545c24bdff#n15. 
  16. ↑ xattr(7) – Linux Programmer's Manual – Overview, Conventions and Miscellanea
  17. ↑ "Commands for Manipulating Filesystem Extended Attributes". https://savannah.nongnu.org/projects/attr/. 
  18. ↑ listxattr(2) – Darwin and macOS System Calls Manual
  19. ↑ getxattr(2) – Darwin and macOS System Calls Manual
  20. ↑ setxattr(2) – Darwin and macOS System Calls Manual
  21. ↑ removexattr(2) – Darwin and macOS System Calls Manual
  22. ↑ xattr(1) – Darwin and macOS General Commands Manual
  23. ↑ "Launch Services Release Notes". https://developer.apple.com/library/archive/releasenotes/Carbon/RN-LaunchServices/index.html. 
  24. ↑ Dale Rahn (2005-07-03). "CVS log for src/sys/ufs/ufs/Attic/extattr.h". https://cvsweb.openbsd.org/src/sys/ufs/ufs/Attic/extattr.h. 
  25. ↑ 25.0 25.1 Eager, Bob (2000-10-28). "Implementation of extended attributes on the FAT file system". http://www.tavi.co.uk/os2pages/eadata.html. 
  26. ↑ fsattr(7) – Solaris 10 Device and Network Interfaces Reference Manual
  27. ↑ Hammons, Jack (2016-06-15). "WSL File System Support". MSDN. https://blogs.msdn.microsoft.com/wsl/2016/06/15/wsl-file-system-support/. 
  28. ↑ "NTFS Descriptions 1.2.1". https://totalcmd.net/plugring/NTFS_diz.html. 
  29. ↑ "QuickSearch eXtended". http://totalcmd.net/plugring/google_like_qs.html. 
  30. ↑ "Extended Attributes". https://www.tuxera.com/community/ntfs-3g-advanced/extended-attributes/. 



Retrieved from "https://handwiki.org/wiki/index.php?title=Extended_file_attributes&oldid=3365662"