Webserver directory index
When an HTTP client (generally a web browser) requests a URL that points to a directory structure instead of an actual web page within the directory structure, the web server will generally serve a default page, which is often referred to as a main or "index" page.
A common filename for such a page is index.html, but most modern HTTP servers offer a configurable list of filenames that the server can use as an index. If a server is configured to support server-side scripting, the list will usually include entries allowing dynamic content to be used as the index page (e.g. index.php, index.shtml, index.jsp, default.asp) even though it may be more appropriate to still specify the HTML output (index.html.php or index.html.aspx), as this should not be taken for granted. An example is the popular open source web server Apache, where the list of filenames is controlled by the DirectoryIndex[1] directive in the main server configuration file or in the configuration file for that directory. It is possible to not use file extensions at all, and be neutral to content delivery methods, and set the server to automatically pick the best file through content negotiation.
If the server is unable to find a file with any of the names listed in its configuration, it may either return an error (generally 404 Not Found) or generate its own index page listing the files in the directory. It may also return a 403 Index Listing Forbidden. Usually this option is also configurable.
History
A scheme where web server serves a default file on per-subdirectory basis has been supported as early as NCSA HTTPd 0.3beta (22 April 1993),[2] which defaults to serve index.html file in the directory.[2][3] This scheme has been then adopted by CERN HTTPd since at least 2.17beta (5 April 1994), whose default supports Welcome.html and welcome.html in addition to the NCSA-originated index.html.[4]
Later web servers typically support this default file scheme in one form or another; this is usually configurable, with index.html being one of the default file names.[5][6][7]
Implementation
In some cases, the home page of a website can be a menu of language options for large sites that use geotargeting. It is also possible to avoid this step, for example, by using content negotiation.
In cases where no index.html exists within a given directory, the web server may be configured to provide an automatically-generated listing of the files within the directory instead. With the Apache web server, for example, this behavior is provided by the mod_autoindex module[8] and controlled by the Options +Indexes directive[9] in the web server configuration files. These automated directory listings are sometimes a security risk because they enumerate sensitive files which may not be intended for public access, in a process known as a directory indexing attack.[10] Such a security misconfiguration[11] may also assist in other attacks, such as a path or directory traversal attack.[12]
References
- ↑ "mod_dir - Apache HTTP Server". httpd.apache.org. http://httpd.apache.org/docs/2.0/mod/mod_dir.html#directoryindex.
- ↑ 2.0 2.1 "WWW-Talk Apr-Jun 1993: NCSA httpd version 0.3". http://1997.webhistory.org/www.lists/www-talk.1993q2/0135.html.
- ↑ "NCSA HTTPd DirectoryIndex". January 31, 2009. http://hoohoo.ncsa.uiuc.edu/docs/setup/srm/DirectoryIndex.html.
- ↑ "Change History of W3C httpd". June 5, 1997. http://www.w3.org/pub/WWW/Daemon/Features.html.
- ↑ "mod_dir - Apache HTTP Server Version 2.4 § DirectoryIndex Directive". https://httpd.apache.org/docs/2.4/mod/mod_dir.html#directoryindex.
- ↑ "NGINX Docs | Serving Static Content". https://docs.nginx.com/nginx/admin-guide/web-server/serving-static-content/.
- ↑ "Default Document <defaultDocument> | Microsoft Docs". https://docs.microsoft.com/en-us/iis/configuration/system.webserver/defaultdocument/.
- ↑ "mod_autoindex - Apache HTTP Server Version 2.4". https://httpd.apache.org/docs/2.4/mod/mod_autoindex.html.
- ↑ "core - Apache HTTP Server Version 2.4 § Options Directive". https://httpd.apache.org/docs/2.4/mod/core.html#options.
- ↑ "IBM Docs". 2021-03-08. https://www.ibm.com/docs/en/snips/4.6.0?topic=categories-directory-indexing-attacks.
- ↑ "A6:2017-Security Misconfiguration". https://owasp.org/www-project-top-ten/2017/A6_2017-Security_Misconfiguration.html.
- ↑ "Path Traversal". https://owasp.org/www-community/attacks/Path_Traversal.
 |
