Software:rm (Unix)

From HandWiki
Short description: Unix command utility

rm
Rm --help Command - Unix.png
The rm command
Original author(s)Ken Thompson, Dennis Ritchie
(AT&T Bell Laboratories)
Developer(s)Various open-source and commercial developers
Initial releaseNovember 3, 1971; 52 years ago (1971-11-03)
Written inC
Operating systemUnix, Unix-like, V, Plan 9, Inferno, KolibriOS, IBM i
PlatformCross-platform
TypeCommand
Licensecoreutils: GPLv3+
Plan 9: MIT License

rm (short for remove) is a basic command on Unix and Unix-like operating systems used to remove objects such as computer files, directories and symbolic links from file systems and also special files such as device nodes, pipes and sockets, similar to the del command in MS-DOS, OS/2, and Microsoft Windows. The command is also available in the EFI shell.[1]

Overview

The rm command removes references to objects from the filesystem using the unlink system call, where those objects might have had multiple references (for example, a file with two different names), and the objects themselves are discarded only when all references have been removed and no programs still have open handles to the objects.

This allows for scenarios where a program can open a file, immediately remove it from the filesystem, and then use it for temporary space, knowing that the file's space will be reclaimed after the program exits, even if it exits by crashing.

The command generally does not destroy file data, since its purpose is really merely to unlink references, and the filesystem space freed may still contain leftover data from the removed file. This can be a security concern in some cases, and hardened versions sometimes provide for wiping out the data as the last link is being cut, and programs such as shred and srm are available which specifically provide data wiping capability.

rm is generally only seen on UNIX-derived operating systems, which typically do not provide for recovery of deleted files through a mechanism like the recycle bin,[2] hence the tendency for users to enclose rm in some kind of wrapper to limit accidental file deletion.

There are undelete utilities that will attempt to reconstruct the index and can bring the file back if the parts were not reused.

History

On some old versions of Unix, the rm command would delete directories if they were empty.[3] This behaviour can still be obtained in some versions of rm with the -d flag, e.g., the BSDs (such as FreeBSD,[4] NetBSD,[5] OpenBSD[6] and macOS) derived from 4.4BSD-Lite2.

The version of rm bundled in GNU coreutils was written by Paul Rubin, David MacKenzie, Richard Stallman, and Jim Meyering.[7] This version also provides -d option, to help with compatibility.[8] The same functionality is provided by the standard rmdir command.

The -i option in Version 7 replaced dsw, or "delete from switches", which debuted in Version 1. Doug McIlroy wrote that dsw "was a desperation tool designed to clean up files with unutterable names".[9]

The command is available as a separate package for Microsoft Windows as part of the UnxUtils collection of native Win32 ports of common GNU Unix-like utilities.[10] KolibriOS includes an implementation of the rm command.[11] The rm command has also been ported to the IBM i operating system.[12]

Syntax

rm deletes the file specified after options are added. Users can use a full path or a relative file path to specify the files to delete. rm doesn't delete a directory by default.[13]rm foo deletes the file "foo" in the directory the user is currently in.

rm, like other commands, uses options to specify how it will behave:

  • -r, "recursive," which removes directories, removing the contents recursively beforehand (so as not to leave files without a directory to reside in).
  • -i, "interactive" which asks for every deletion to be confirmed.
  • -f, "force," which ignores non-existent files and overrides any confirmation prompts (effectively canceling -i), although it will not remove files from a directory if the directory is write-protected.
  • -v, "verbose," which prints what rm is doing onto the terminal
  • -d, "directory," which deletes an empty directory, and only works if the specified directory is empty.
  • --one-file-system, only removes files on the same file system as the argument, and will ignore mounted file systems.

rm can be overlain by a shell alias (C shell alias, Bourne shell or Bash) function of "rm -i" so as to avoid accidental deletion of files. If a user still wishes to delete a large number of files without confirmation, they can manually cancel out the -i argument by adding the -f option (as the option specified later on the expanded command line "rm -i -f" takes precedence). Unfortunately this approach generates dangerous habits towards the use of wildcarding, leading to its own version of accidental removals.

rm -rf (variously, rm -rf /, rm -rf *, and others) is frequently used in jokes and anecdotes about Unix disasters,[14] such as the loss of many files during the production of film Toy Story 2 at Pixar.[15] The rm -rf / variant of the command, if run by a superuser, would cause every file accessible from the present file system to be deleted from the machine.

rm is often used in conjunction with xargs to supply a list of files to delete:

xargs rm < filelist

Or, to remove all PNG images in all directories below the current one:

find . -name '*.png' -exec rm {} +

Permissions

Usually, on most filesystems, deleting a file requires write permission on the parent directory (and execute permission, in order to enter the directory in the first place). (Note that, confusingly for beginners, permissions on the file itself are irrelevant. However, GNU rm asks for confirmation if a write-protected file is to be deleted, unless the -f option is used.)[16]

To delete a directory (with rm -r), one must delete all of its contents recursively. This requires that one must have read and write and execute permission to that directory (if it's not empty) and all non-empty subdirectories recursively (if there are any). The read permissions are needed to list the contents of the directory in order to delete them. This sometimes leads to an odd situation where a non-empty directory cannot be deleted because one doesn't have write permission to it and so cannot delete its contents; but if the same directory were empty, one would be able to delete it.[17]

If a file resides in a directory with the sticky bit set, then deleting the file requires one to be the owner of the file.

Protection of the filesystem root

Sun Microsystems introduced "rm -rf /" protection in Solaris 10, first released in 2005. Upon executing the command, the system now reports that the removal of / is not allowed.[18] Shortly after, the same functionality was introduced into FreeBSD version of rm utility.[19] GNU rm refuses to execute rm -rf / if the --preserve-root option is given,[20] which has been the default since version 6.4 of GNU Core Utilities was released in 2006. In newer systems, this failsafe is always active, even without the option. To run the command, user must bypass the failsafe by adding the option --no-preserve-root, even if they are the superuser.

User-proofing

Systems administrators, designers, and even users often attempt to defend themselves against accidentally deleting files by creating an alias or function along the lines of:

alias rm="rm -i"
rm () { /bin/rm -i "$@" ; }

This results in rm asking the user to confirm on a file-by-file basis whether it should be deleted, by pressing the Y or N key. Unfortunately, this tends to train users to be careless about the wildcards they hand into their rm commands, as well as encouraging a tendency to alternately pound y and the return key to affirm removes - until just past the one file they needed to keep.[citation needed] Users have even been seen going as far as "yes | rm files", which automatically inserts "y" for each file. [citation needed]

A compromise that allows users to confirm just once, encourages proper wildcarding, and makes verification of the list easier can be achieved with something like:

if [ -n "$PS1" ] ; then
  rm () 
  { 
      ls -FCsd "$@"
      echo 'remove[ny]? ' | tr -d '\012' ; read
      if [ "_$REPLY" = "_y" ]; then
          /bin/rm -rf "$@"
      else
          echo '(cancelled)'
      fi
  }
fi

It is important to note that this function should not be made into a shell script, which would run a risk of it being found ahead of the system rm in the search path, nor should it be allowed in non-interactive shells where it could break batch jobs. Enclosing the definition in the if [ -n "$PS1" ] ; then ....  ; fi construct protects against the latter.

There exist third-party alternatives which prevent accidental deletion of important files, such as "safe-rm"[21] or "trash".[22]

Maximum command line argument limitation

GNU Core Utilities implementation used in multiple Linux distributions will be limited in command line arguments bytes number of pages that are allocated within the kernel for command-line arguments before kernel 2.6.23 Released on 9 October 2007[23][24] were defined at kernel compile time at variable MAX_ARG_PAGES in include/linux/binfmts.h file but new kernels limits the maximum argument length to 25% of the maximum stack limit (ulimit -s). Error: /bin/rm: Argument list too long. will prompt if command-line argument limit is exceed[25]

See also

References

  1. "EFI Shells and Scripting". Intel. http://software.intel.com/en-us/articles/efi-shells-and-scripting/. 
  2. "Unix - Frequently Asked Questions (3/7) [Frequent postingSection - How do I "undelete" a file?"]. http://www.faqs.org/faqs/unix-faq/faq/part3/section-6.html. 
  3. "rm page from Section 1 of the unix 8th manual". http://man.cat-v.org/unix_8th/1/rm. 
  4. "RM(1)", FreeBSD-5.4-RELEASE, http://modman.unixdev.net/?manpath=FreeBSD-5.4-RELEASE&page=rm&sektion=1&apropos=, retrieved February 5, 2015 
  5. "RM(1)", NetBSD-2.0, http://modman.unixdev.net/?manpath=NetBSD-2.0&page=rm&sektion=1&apropos=, retrieved February 5, 2015 
  6. "RM(1)", OpenBSD-3.6, http://modman.unixdev.net/?manpath=OpenBSD-3.6&page=rm&sektion=1&apropos=, retrieved February 5, 2015 
  7. "rm(1): remove files/directories - Linux man page". https://linux.die.net/man/1/rm. 
  8. Krzysztof Goj (January 22, 2012). "rm: new option --dir (-d) to remove empty directories". http://git.savannah.gnu.org/cgit/coreutils.git/commit/src/rm.c?id=fdc2da7165d93c8065365999341173ad2a818833. 
  9. Template:Cite tech report
  10. "Native Win32 ports of some GNU utilities". http://unxutils.sourceforge.net/. 
  11. "Shell - KolibriOS wiki". http://wiki.kolibrios.org/wiki/Shell. 
  12. IBM. "IBM System i Version 7.2 Programming Qshell" (in en). https://www.ibm.com/support/knowledgecenter/ssw_ibm_i_74/rzahz/rzahzpdf.pdf?view=kc. 
  13. "rm(1) - Linux manual page". https://man7.org/linux/man-pages/man1/rm.1.html. 
  14. Gite, Vivek. "Linux/UNIX: Delete a file". Nixcraft. http://www.cyberciti.biz/faq/howto-linux-unix-delete-remove-file/. 
  15. Panzarino, Matthew (21 May 2012). "How Toy Story 2 Got Deleted Twice, Once on Accident, Again on purpose" (in en). https://thenextweb.com/news/how-pixars-toy-story-2-was-deleted-twice-once-by-technology-and-again-for-its-own-good. 
  16. "Linux rm command help and examples". ComputerHope. 24 January 2018. https://www.theinquirer.net/inquirer/news/2454743/man-destroys-his-entire-company-with-a-five-character-bash-command. 
  17. McElhearn, Kirk (2 January 2014). "Master the command line: Deleting files and folders". Macworld. https://www.macworld.com/article/2082021/master-the-command-line-deleting-files-and-folders.html. 
  18. "Meddling in the Affairs of Wizards". https://blogs.oracle.com/jbeck/date/20041001%23rm_rf_protection. 
  19. "The previous commit added code to rm(1) to warn about and remove any · freebsd/freebsd@d6b7bd9". https://github.com/freebsd/freebsd/commit/d6b7bd90c2776d9ccd8bb7f33a899bd213aebf85. 
  20. "rm invocation (GNU Coreutils)". https://www.gnu.org/software/coreutils/manual/html_node/rm-invocation.html. 
  21. "Safe-rm in Launchpad". https://launchpad.net/safe-rm/+index. 
  22. "andreafrancia/trash-cli". September 12, 2020. https://github.com/andreafrancia/trash-cli. 
  23. "Linux_2_6_23 - Linux Kernel Newbies". https://kernelnewbies.org/Linux_2_6_23#Variable_argument_length. 
  24. "kernel/git/torvalds/linux.git - Linux kernel source tree". https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=b6a2fea39318e43fee84fa7b0b90d68bed92d2ba. 
  25. ""Argument list too long": Beyond Arguments and Limitations | Linux Journal". https://www.linuxjournal.com/article/6060. 

Further reading

External links