Timeline of web search engines

From HandWiki
Short description: none

This page provides a full timeline of web search engines, starting from the WHOis in 1982, the Archie search engine in 1990, and subsequent developments in the field. It is complementary to the history of web search engines page that provides more qualitative detail on the history.

Timeline

Year Month Day Event type Event
1990 September [1] 10 (released) [1] Pre-web content search engine The Archie search engine, created by Alan Emtage [2][3][4][5] computer science student at McGill University in Montreal , goes live. The program downloads the directory listings of all the files located on public anonymous FTP (File Transfer Protocol) sites, creates a searchable database of a lot of file names; however, Archie does not index the contents of these sites since the amount of data is so limited it can be readily searched manually.[6][7][8][9]
1991 Pre-web search engine The rise of Gopher (created in 1991 by Mark McCahill at the University of Minnesota) leads to two new search programs, Veronica and Jughead. Like Archie, they search the file names and titles stored in Gopher index systems. Veronica (Very Easy Rodent-Oriented Net-wide Index to Computerized Archives) provides a keyword search of most Gopher menu titles in the entire Gopher listings. Jughead (Jonzy's Universal Gopher Hierarchy Excavation And Display) is a tool for obtaining menu information from specific Gopher servers. While the name of the search engine "Archie" was not a reference to the Archie comic book series, "Veronica" and "Jughead" are characters in the series, thus referencing their predecessor.[8]
1992 Virtual library of the web Tim Berners-Lee sets up the Virtual Library (VLib), a loose confederation of topical experts maintaining relevant topical link lists.[8][9]
1993 June First web robot Matthew K. Gray produces the first known web robot, the Perl-based World Wide Web Wanderer, and uses it to generate an index of the web called the Wandex.[8][9][10] However, the World Wide Web Wanderer is intended only to measure the size of the web rather than to facilitate search.
September 2 First web search engine W3Catalog, written by Oscar Nierstrasz at the University of Geneva, is released to the world. It is the world's first web search engine. It does not rely on a crawler and indexer but rather on already existing high-quality lists of websites. One of its main drawbacks is that the bot accesses each page hundreds of times each day, causing performance degradation.[8][9][11][12]
October/November Second web search engine Aliweb, a web search engine created by Martijn Koster, is announced. It does not use a web robot, but instead depends on being notified by website administrators of the existence at each site of an index file in a particular format. The absence of a bot means that less bandwidth is used; however, most website administrators are not aware of the need to submit their data.[8][9]
December First web search engine to use a crawler and indexer JumpStation, created by Jonathon Fletcher, is released. It is the first WWW resource-discovery tool to combine the three essential features of a web search engine (crawling, indexing, and searching).[8][9][13]
1994 January New web directory Yahoo!, founded by Jerry Yang and David Filo, launches Yahoo! Directory.[9] It becomes the first popular Web directory.[14]
New web search engine Infoseek is launched.[8][9]
March New web search engine The World-Wide Web Worm is released. It is claimed to have been created in September 1993, at which time there did not exist any crawler-based search engine, but it is not the earliest at the time of its actual release. It supports Perl-based regular expressions.[8][9]
April 20 New web search engine The WebCrawler search engine, created by Brian Pinkerton at the University of Washington, is released.[9] Unlike its predecessors, it allows users to search for any word in any webpage, which has become the standard for all major search engines since.
July New web search engine Lycos, a web search engine, is released.[9] It began as a research project by Michael Loren Mauldin of Carnegie Mellon University's main Pittsburgh campus.
1995 New search engine Yahoo! Search is launched. It is a search function that allows users to search Yahoo! Directory.[15][16] It becomes the first popular search engine on the Web.[14] However, it is not a true Web crawler search engine.
New search engine Search.ch is launched. It is a search engine and web portal for Switzerland .[17]
New web directory LookSmart is released. It competes with Yahoo! as a web directory, and the competition makes both directories more inclusive.
December Web search engine supporting natural language queries Altavista is launched. This is a first among web search engines in many ways: it has unlimited bandwidth, allows natural language queries, has search tips, and allows people to add or delete their domains in 24 hours.[8][9]
1996 New web search engine Robin Li developed the RankDex site-scoring algorithm for search engines results page ranking[18][19][20] and received a US patent for the technology.[21] It was the first search engine that used hyperlinks to measure the quality of websites it was indexing,[22] predating the very similar algorithm patent filed by Google two years later in 1998.[23] Larry Page referenced Li's work as a citation in some of his U.S. patents for PageRank.[24] Li later used his Rankdex technology for the Baidu search engine.
January–March New web search engine Larry Page and Sergey Brin begin working on BackRub, the predecessor to Google Search. The crawler begins activity in March.[9]
May New web search engine Inktomi releases its HotBot search engine.[9]
October New web search engine Gary Culliss and Steven Yang begin work at MIT on the popularity engine, a version of the Direct Hit Technologies search engine that ranks results across users according to the selections made during previous searches.
1997 April New natural language-based web search engine Ask Jeeves, a natural language web search engine, that aims to rank links by popularity, is released. It would later become Ask.com.[9][25]
September 15 New web search engine The domain Google.com is registered.[25] Soon, Google Search is available to the public from this domain (around 1998).
23 New web search engine (non-English) Arkady Volozh and Ilya Segalovich launch their Russian web search engine Yandex and publicly present it at the Softool exhibition in Moscow. The initial development is by Comptek; Yandex would become a separate company in 2000.[26]
1998 June 5 New web directory Gnuhoo, a web directory project by Rich Skrenta and Bob Truel, both employees of Sun Microsystems, launches.[9][27] It would later be renamed the Open Directory Project.
July–September New web search portal MSN launches a search portal called MSN Search, using search results from Inktomi. After many changes to the backend search engine, MSN would start developing in-house search technology in 2005, and later change its name to Bing in June 2009.
1999 May New web search engine AlltheWeb, based on the Ph.D. thesis of Tor Egge at the Norwegian University of Science and Technology, titled FTP Search, launches. The engine is launched by Egge's company Fast Search & Transfer, established on July 16, 1997.[9]
2000 January 1 New web search portal Baidu, a Chinese company that would grow to provide many search-related services, launches. It was founded by Robin Li, who previously developed RankDex in 1996.
2002-3 Web search business consolidation Yahoo! buys Inktomi (2002) and then Overture Services Inc. (2003) which has already bought AlltheWeb and Altavista. Starting 2003, Yahoo! starts using its own Yahoo Slurp web crawler to power Yahoo! Search. Yahoo! Search combines the technologies of all Yahoo!'s acquisitions (until 2002, Yahoo! had been using Google to power its search).
2004-5 November (2004) - February (2005) Change in backend providers Microsoft starts using its own indexer and crawler for MSN Search rather than using blended results from LookSmart and Inktomi.
2005 January Webmaster tools To combat link spam, Google, Yahoo! and Microsoft collectively introduce the nofollow attribute.[28]
October New web search engine Overture Services Inc. owner Bill Gross launches the Snap search engine, with many features such as display of search volumes and other information, as well as sophisticated auto-completion and related terms display. It is unable to get traction and soon goes out of business.[9][29]
2006 December 23 (proposed) New human-curated web search engine Wikia Search (Wikia), a search engine based on human curation.[30]
2007 January 31 (re-proposed) Wikia Search [31]
December 24 private pre-alpha release of Wikia Search [32][33]
2008 January 28 New web search engine Cuil, a web search engine created by ex-Googlers that uses picture thumbnails to display search results, launches.[34] It would later shut down on September 17, 2010.[35][36][37]
August Wikia Search toolbar release [38]
September 25 New web search engine DuckDuckGo (DDG), a web search engine focused on protecting searchers' privacy by not profiling its users, launches.[39][40]
2009 March–May shutdown of 'Wikia Search [38]
July 29 Web search engine consolidation Microsoft and Yahoo! announce that they have made a ten-year deal in which the Yahoo! search engine would be replaced by Bing. Yahoo! will get to keep 88% of the revenue from all search ad sales on its site for the first five years of the deal, and have the right to sell adverts on some Microsoft sites. Yahoo! Search will still maintain its own user interface, but will eventually feature "Powered by Bing™" branding.[41][42] All Yahoo! Search global customers and partners are expected to be transitioned by early 2012.[43]
2010
September 8 User experience Google launches Google Instant, described as a search-before-you-type feature: as users are typing, Google predicts the user's whole search query (using the same technology as in Google Suggest, later called the autocomplete feature) and instantaneously shows results for the top prediction.[44][45][46] Google claims that this is estimated to save 2–5 seconds per search query.[47] SEO commentators initially believe that this will have a major effect on search engine optimization, but soon revise downward their estimate of the impact.[28][48]
November 1 New web search engine Blekko, a search engine that uses slashtags to allow people to search in more targeted categories, launches.[49]
2011
2012
May 10 User experience Microsoft announces a redesign of its Bing search engine that includes "Sidebar", a social feature that searches users' social networks for information relevant to the search query.[50]
16 Search algorithm update Google starts rolling out Knowledge Graph, used by Google internally to store semantic relationships between objects. Google now begins displaying supplemental information about objects related to search queries on the side.[28][51][52][53]
2013 April 13 New web search engine Pipilika, first Bangla search engine, launched.[54]
2013 July 4 New web search engine French search engine Qwant launched and operated from Paris. It claims that it does not employ user tracking or personalize search results in order to avoid trapping users in a filter bubble. The search engine is available in 26 languages.

See also

References

  1. 1.0 1.1 David Shedden (10 September 2014). "Today in media history: The first Internet search engine is released in 1990". https://www.poynter.org/reporting-editing/2014/today-in-media-history-the-first-internet-search-engine-is-released-in-1990/. 
  2. pcmag. "Archie". pcmag.com. https://www.pcmag.com/encyclopedia/term/archie. 
  3. Alexandra Samuel. "Meet Alan Emtage, the Black Technologist Who Invented ARCHIE, the First Internet Search Engine". ITHAKA. https://daily.jstor.org/alan-emtage-first-internet-search-engine/. 
  4. loop news barbados. "Alan Emtage- a Barbadian you should know". loopnewsbarbados.com. http://www.loopnewsbarbados.com/content/alan-emtage-barbadian-you-should-know. 
  5. Dino Grandoni, Alan Emtage. "Alan Emtage: The Man Who Invented The World's First Search Engine (But Didn't Patent It)". huffingtonpost.co.uk. https://www.huffingtonpost.co.uk/entry/alan-emtage-search-engine_n_2994090?ri18n=true&guccounter=1&guce_referrer=aHR0cHM6Ly9jb25zZW50LnlhaG9vLmNvbS8&guce_referrer_sig=AQAAABveQefuoczW_8_bxwbOgluVTUPvIfv5s_OP1jMgUJd8MCwKc148lvXb7HAHXY48P_Be6wXMW0LKlLRfQzJNalLpuwnp7F6NpbyDC2BG10OveS2qtubkO0PhJ8-juP3M2a9K2ygbWuoUhOCvO-1NA6-YQKA8BtdZEcsfUUI_M-8S. 
  6. "The First Search Engine, Archie". http://www.isrl.uiuc.edu/~chip/projects/timeline/1990archie.htm. 
  7. "In Russian: History of the Internet. The First Search Engine". http://www.xserver.ru/computer/nets/internet/196/. 
  8. 8.0 8.1 8.2 8.3 8.4 8.5 8.6 8.7 8.8 8.9 "Search Engine History". http://www.searchenginehistory.com/. 
  9. 9.00 9.01 9.02 9.03 9.04 9.05 9.06 9.07 9.08 9.09 9.10 9.11 9.12 9.13 9.14 9.15 9.16 9.17 "History of Search Engines - Chronological List of Internet Search Engines". http://www.wordstream.com/articles/internet-search-engines-history. 
  10. Gray, Matthew. "Internet Growth and Statistics: Credit and Background". https://www.mit.edu/~mkgray/net/background.html. 
  11. "W3 Catalog History". http://scg.unibe.ch/archive/software/w3catalog/. 
  12. Thomas R. Gruber, Sunil Vemuri and James Rice (December 1995). "Virtual documents that explain How Things Work: Dynamically generated question-answering documents". Knowledge Systems Laboratory, Stanford University. http://www-ksl.stanford.edu/people/gruber/virtual-documents-htw/. 
  13. "Why we nearly McGoogled it". Metro. March 15, 2009. http://metro.co.uk/2009/03/15/why-we-nearly-mcgoogled-it-545208/. 
  14. 14.0 14.1 "What is first mover?". TechTarget. September 2005. https://searchcio.techtarget.com/definition/first-mover. 
  15. Oppitz, Marcus; Tomsu, Peter (2017). Inventing the Cloud Century: How Cloudiness Keeps Changing Our Life, Economy and Technology. Springer. p. 238. ISBN 9783319611617. https://books.google.com/books?id=vrEvDwAAQBAJ&pg=PA238. 
  16. "Yahoo! Search". 28 November 1996. http://www.yahoo.com/search.html. 
  17. "search.ch AG in Zürich" (in en). http://www.moneyhouse.ch/en/company/search-ch-ag-12035081801. 
  18. Greenberg, Andy, "The Man Who's Beating Google", Forbes magazine, October 5, 2009
  19. Yanhong Li, "Toward a Qualitative Search Engine," IEEE Internet Computing, vol. 2, no. 4, pp. 24–29, July/Aug. 1998, doi:10.1109/4236.707687
  20. "About: RankDex", rankdex.com
  21. USPTO, "Hypertext Document Retrieval System and Method", US Patent number: 5920859, Inventor: Yanhong Li, Filing date: Feb 5, 1997, Issue date: Jul 6, 1999
  22. "Baidu Vs Google: The Twins Of Search Compared". 18 September 2018. https://fourweekmba.com/baidu-vs-google/. 
  23. Altucher, James (March 18, 2011). "10 Unusual Things About Google". https://www.forbes.com/sites/jamesaltucher/2011/03/18/10-unusual-things-about-google-also-the-worst-vc-decision-i-ever-made/. 
  24. "Method for node ranking in a linked database". Google Patents. https://www.google.com/patents/US6285999. 
  25. 25.0 25.1 "Our history in depth". September 15, 1997. https://www.google.com/about/company/history/. 
  26. About Yandex — History of Yandex. Retrieved May 24, 2011. Archived copy.
  27. "The GnuHoo BooBoo". Slashdot. http://slashdot.org/article.pl?sid=98/06/23/0849239. 
  28. 28.0 28.1 28.2 "Google Algorithm Change History". SEOmoz. http://moz.com/google-algorithm-change. 
  29. Boswell, Wendy. "Snap - A New Kind of Search Engine". About.com. http://websearch.about.com/od/enginesanddirectories/a/snap.htm. 
  30. Doran, James (December 23, 2006). "Founder of Wikipedia plans search engine to rival Google". The Times. London. http://business.timesonline.co.uk/article/0,,9075-2517026,00.html. 
  31. Wales: Search Wikia Will Succeed Where Google Cannot, InformationWeek, February 5, 2007. Retrieved July 27, 2007.
  32. Wales, Jimmy (December 24, 2007). "private pre-alpha invites available". http://lists.wikia.com/pipermail/search-l/2007-December/000845.html. 
  33. "Wikia Search Project to Launch January 7, Wales says". The Washington Post. December 24, 2007. https://www.washingtonpost.com/wp-dyn/content/article/2007/12/24/AR2007122401567.html. 
  34. Liedtke, Michael, Ex-Google engineers debut 'Cuil' way to search, Associated Press, 28 July 2008, retrieved 13 Dec 2009
  35. Michael Arrington (2010-09-17). "Cuil Goes Down, And We Hear It's Down For Good". TechCrunch. https://techcrunch.com/2010/09/17/cuil-goes-down-and-we-hear-its-down-for-good/. 
  36. Devindra, Hardawar (2010-09-17). "Supposed Google-killer Cuil's reign of terror may finally be over". VentureBeat. https://venturebeat.com/2010/09/17/supposed-google-killer-cuils-reign-of-terror-may-finally-be-over/. 
  37. "Cuil is Stone Cold – Another 'Google Killer' Bites the Dust". SearchEngineWatch. 2010-09-18. http://blog.searchenginewatch.com/100918-132701. 
  38. 38.0 38.1 Wales giving up on Wikia Search
  39. "DuckDuckGo: A New Search Engine Built from Open Source". 2011-03-17. http://ostatic.com/blog/duckduckgo-a-new-search-engine-built-from-open-source. 
  40. "DuckDuckGo Privacy" (in en-US). https://duckduckgo.com/privacy. 
  41. "Microsoft and Yahoo seal web deal". BBC News. 29 July 2009. http://news.bbc.co.uk/2/hi/business/8174763.stm. 
  42. Tiffany Wu; Derek Caney (Jul 29, 2009). "REFILE-UPDATE 1-Microsoft, Yahoo in 10-year Web search deal". Thomson Reuters. https://www.reuters.com/article/CMPSRV/idUSN2921665320090729. 
  43. "When will the change happen? How long will the transition take?". Yahoo!. 1 December 2011. http://help.yahoo.com/l/us/yahoo/search/alliance/alliance-2.html;_ylt=AvrC8b99B5.r4JmW33gA5ChaMnlG. 
  44. "Search: now faster than the speed of type". Official Google Blog. September 8, 2010. http://googleblog.blogspot.com/2010/09/search-now-faster-than-speed-of-type.html. 
  45. Tsotsis, Alexia (September 8, 2010). "Google Instant: It Searches Before You Type". TechCrunch. https://techcrunch.com/2010/09/08/google-instant-its-search-before-you-type/. 
  46. "Google Instant, behind the scenes". Official Google Blog. September 9, 2010. http://googleblog.blogspot.com/2010/09/google-instant-behind-scenes.html. 
  47. "About Google Instant". https://www.google.com/insidesearch/features/instant/about.html. 
  48. Fishkin, Rand (September 21, 2010). "Google Instant: Fewer Changes to SEO than the Average Algo Update". SEOmoz. http://moz.com/blog/google-instant-fewer-changes-to-seo-than-the-average-algo-update. 
  49. Efrati, Amir (November 1, 2010). "Start-Up Aims at Google: Blekko.com Taps Users to Narrow Results, Avoid Spam Sites". Wall Street Journal. https://www.wsj.com/articles/SB10001424052748704477904575586551374128996?mod=googlenews_wsj. 
  50. Goldman, David (10 May 2012). "Bing fires at Google with new social search". https://money.cnn.com/2012/05/10/technology/bing-redesign/index.htm?source=cnn_bin. 
  51. Singhal, Amit (May 16, 2012). "Introducing the Knowledge Graph: things, not strings". The Official Google Blog. http://googleblog.blogspot.com/2012/05/introducing-knowledge-graph-things-not.html. 
  52. Sullivan, Danny (May 16, 2012). "Google Launches Knowledge Graph To Provide Answers, Not Just Links". Search Engine Land. http://searchengineland.com/google-launches-knowledge-graph-121585. 
  53. Lardinois, Frederic (May 16, 2012). "Google Just Got A Whole Lot Smarter, Launches Its Knowledge Graph". TechCrunch. https://techcrunch.com/2012/05/16/google-just-got-a-whole-lot-smarter-launches-its-knowledge-graph/. 
  54. প্রতিবেদক, নিজস্ব. "পিপীলিকার পথচলা শুরু" (in bn). https://www.prothomalo.com/old-prothomalo/পিপীলিকার-পথচলা-শুরু.