mod_oai

mod_oai is an Apache module that allows web crawlers to efficiently discover new, modified, and deleted web resources from a web server by using OAI-PMH, a protocol which is widely used in the digital libraries community. mod_oai also allows harvesters to obtain "archive-ready" resources from a web server.

The mod_oai project is housed at Old Dominion University under the direction of Michael L. Nelson. mod_oai is developed under the GNU General Public License (GPL), and is distributed free of charge.

References

• Michael L. Nelson; Joan A. Smith; Ignacio Garcia del Campo; Herbert Van de Sompel; Xiaoming Liu (2006). "Efficient, Automatic Web Resource Harvesting". Proceedings of the 8th ACM International Workshop on Web Information and Data Management (WIDM 2006). doi:10.1145/1183550.1183560. http://public.lanl.gov/herbertv/papers/f140-nelson.pdf. 

External links

• modoai download at modoai.org
• modoai - Apache module implementing OAI-PMH protocol