Semantic Scholar

From HandWiki
Short description: Search service for journal articles
Semantic Scholar
Semantic Scholar logo.svg
Type of site
Search engine
Created byAllen Institute for Artificial Intelligence
Websitesemanticscholar.org
LaunchedNovember 2, 2015; 8 years ago (2015-11-02)[1]

Semantic Scholar is a research tool for scientific literature powered by artificial intelligence. It is developed at the Allen Institute for AI and was publicly released in November 2015.[2] Semantic Scholar uses modern techniques in natural language processing to support the research process, for example by providing automatically generated summaries of scholarly papers.[3] The Semantic Scholar team is actively researching the use of artificial intelligence in natural language processing, machine learning, human–computer interaction, and information retrieval.[4]

Semantic Scholar began as a database for the topics of computer science, geoscience, and neuroscience.[5] In 2017, the system began including biomedical literature in its corpus.[5] (As of September 2022), it includes over 200 million publications from all fields of science.[6]

Technology

Semantic Scholar provides a one-sentence summary of scientific literature. One of its aims was to address the challenge of reading numerous titles and lengthy abstracts on mobile devices.[7] It also seeks to ensure that the three million scientific papers published yearly reach readers, since it is estimated that only half of this literature is ever read.[8]

Artificial intelligence is used to capture the essence of a paper, generating it through an "abstractive" technique.[3] The project uses a combination of machine learning, natural language processing, and machine vision to add a layer of semantic analysis to the traditional methods of citation analysis, and to extract relevant figures, tables, entities, and venues from papers.[9][10]

Another key AI-powered feature is Research Feeds, an adaptive research recommender that uses AI to quickly learn what papers users care about reading and recommends the latest research to help scholars stay up to date. It uses a state-of-the-art paper embedding model trained using contrastive learning to find papers similar to those in each Library folder.[11]

Semantic Scholar also offers Semantic Reader, an augmented reader with the potential to revolutionize scientific reading by making it more accessible and richly contextual.[12] Semantic Reader provides in-line citation cards that allow users to see citations with TLDR summaries as they read and skimming highlights that capture key points of a paper so users can digest faster.

In contrast with Google Scholar and PubMed, Semantic Scholar is designed to highlight the most important and influential elements of a paper.[13] The AI technology is designed to identify hidden connections and links between research topics.[14] Like the previously cited search engines, Semantic Scholar also exploits graph structures, which include the Microsoft Academic Knowledge Graph, Springer Nature's SciGraph, and the Semantic Scholar Corpus.[15]

Each paper hosted by Semantic Scholar is assigned a unique identifier called the Semantic Scholar Corpus ID (abbreviated S2CID). The following entry is an example:

Liu, Ying; Gayle, Albert A; Wilder-Smith, Annelies; Rocklöv, Joacim (March 2020). "The reproductive number of COVID-19 is higher compared to SARS coronavirus". Journal of Travel Medicine 27 (2). doi:10.1093/jtm/taaa021. PMID 32052846. 

Semantic Scholar is free to use and unlike similar search engines (i.e. Google Scholar) does not search for material that is behind a paywall.[5][citation needed]

One study compared the index scope of Semantic Scholar to Google Scholar, and found that for the papers cited by secondary studies in computer science, the two indices had comparable coverage, each only missing a handful of the papers.[16]

Number of users and publications

As of January 2018, following a 2017 project that added biomedical papers and topic summaries, the Semantic Scholar corpus included more than 40 million papers from computer science and biomedicine.[17] In March 2018, Doug Raymond, who developed machine learning initiatives for the Amazon Alexa platform, was hired to lead the Semantic Scholar project.[18] (As of August 2019), the number of included papers metadata (not the actual PDFs) had grown to more than 173 million[19] after the addition of the Microsoft Academic Graph records.[20] In 2020, a partnership between Semantic Scholar and the University of Chicago Press Journals made all articles published under the University of Chicago Press available in the Semantic Scholar corpus.[21] At the end of 2020, Semantic Scholar had indexed 190 million papers.[22]

In 2020, Semantic Scholar reached seven million users per month.[7] It is problematic in that it uses AI, and cannot distinguish therefore between reviews of books and books themselves, frequently listing only the reviews and refusing to include the books reviewed. Furthermore, because it uses science standards—initials plus last name—it cannot distinguish between authors with common names. The field assigned to papers is also not clearly distinguished, listing "History" for Literature papers and similar issues. No citation is necessary for this assertion as users can verify it for themselves: for example, search for "Divine Comedy" (Dante's fourteenth century masterpiece) and get feedback such as a book review appearing as "Art" (see line three, an actual response below).

Terry Eagleton's Divine Comedy

   S. Connor
   Art
   Theory Now Journal of Literature Critique and...
   29 July 2022

This essay reflects on the links between comedy and religion in Terry Eagleton's writing since 2000. It proposes that religious thought provides the same kind of occasion and imperative to...

See also

References

  1. Jones, Nicola (2015). "Artificial-intelligence institute launches free science search engine". Nature. doi:10.1038/nature.2015.18703. ISSN 1476-4687. 
  2. Eunjung Cha, Ariana (3 November 2015). "Paul Allen's AI research group unveils program that aims to shake up how we search scientific knowledge. Give it a try.". The Washington Post. https://www.washingtonpost.com/news/to-your-health/wp/2015/11/02/paul-allens-ai-research-group-unveils-program-that-aims-to-shake-up-how-we-search-scientific-knowledge-give-it-a-try/. 
  3. 3.0 3.1 Hao, Karen (November 18, 2020). "An AI helps you summarize the latest in AI" (in en). https://www.technologyreview.com/2020/11/18/1012259/ai-summarizes-science-papers-ai2-semantic-scholar/. 
  4. "Semantic Scholar Research". https://research.semanticscholar.org/. 
  5. 5.0 5.1 5.2 Fricke, Suzanne (2018-01-12). "Semantic Scholar" (in en). Journal of the Medical Library Association 106 (1): 145–147. doi:10.5195/jmla.2018.280. ISSN 1558-9439. 
  6. Matthews, David (1 September 2021). "Drowning in the literature? These smart software tools can help". Nature. https://www.nature.com/articles/d41586-021-02346-4. "...the publicly available corpus compiled by Semantic Scholar – a tool set up in 2015 by the Allen Institute for Artificial Intelligence in Seattle, Washington – amounting to around 200 million articles, including preprints." 
  7. 7.0 7.1 Grad, Peter (November 24, 2020). "AI tool summarizes lengthy papers in a sentence" (in en). Tech Xplore. https://techxplore.com/news/2020-11-ai-tool-lengthy-papers-sentence.html. 
  8. "Allen Institute's Semantic Scholar now searches across 175 million academic papers" (in en-US). 2019-10-23. https://venturebeat.com/2019/10/23/allen-institutes-semantic-scholar-now-searches-across-175-million-academic-papers/. 
  9. Bohannon, John (11 November 2016). "A computer program just ranked the most influential brain scientists of the modern era". Science. doi:10.1126/science.aal0371. https://www.science.org/content/article/computer-program-just-ranked-most-influential-brain-scientists-modern-era. Retrieved 12 November 2016. 
  10.  , Wikidata Q108172042
  11. "Semantic Scholar | Frequently Asked Questions". https://www.semanticscholar.org/faq#what-are-research-feeds. 
  12. "Semantic Scholar | Semantic Reader". https://www.semanticscholar.org/product/semantic-reader. 
  13. "Semantic Scholar". https://ijlls.org/index.php/ijlls/announcement/view/1. 
  14. Baykoucheva, Svetla (2021) (in en). Driving Science Information Discovery in the Digital Age. Chandos Publishing. pp. 91. ISBN 978-0-12-823724-3. 
  15. Jose, Joemon M.; Yilmaz, Emine; Magalhães, João; Castells, Pablo; Ferro, Nicola; Silva, Mário J.; Martins, Flávio (2020) (in en). Advances in Information Retrieval: 42nd European Conference on IR Research, ECIR 2020, Lisbon, Portugal, April 14–17, 2020, Proceedings, Part I. Cham, Switzerland: Springer Nature. pp. 254. ISBN 978-3-030-45438-8. 
  16. Hannousse, Abdelhakim (2021). "Searching relevant papers for software engineering secondary studies: Semantic Scholar coverage and identification role" (in en). IET Software 15 (1): 126–146. doi:10.1049/sfw2.12011. ISSN 1751-8814. https://onlinelibrary.wiley.com/doi/abs/10.1049/sfw2.12011. 
  17. "AI2 scales up Semantic Scholar search engine to encompass biomedical research" (in en-US). GeekWire. 2017-10-17. https://www.geekwire.com/2017/ai2-semantic-scholar-biomedicine/. 
  18. "Tech Moves: Allen Instititue Hires Amazon Alexa Machine Learning Leader; Microsoft Chairman Takes on New Investor Role; and More". GeekWire. 2018-05-02. https://www.geekwire.com/2018/tech-moves-allen-institute-hires-amazon-alexa-machine-learning-leader-microsoft-chairman-takes-new-investor-role/. 
  19. "Semantic Scholar". https://www.semanticscholar.org/. 
  20. "AI2 joins forces with Microsoft Research to upgrade search tools for scientific studies". 2018-12-05. https://www.geekwire.com/2018/ai2-joins-forces-microsoft-upgrade-search-tools-scientific-research/. 
  21. "The University of Chicago Press joins more than 500 publishers working with Semantic Scholar to improve search and discoverability" (in en). https://www.journals.uchicago.edu/journals/pr/201215. 
  22. Dunn, Adriana (December 14, 2020). "Semantic Scholar Adds 25 Million Scientific Papers in 2020 Through New Publisher Partnerships". Semantic Scholar. https://allenai.org/content/docs/Semantic_Scholar_2020_Publisher_Partners.pdf. 

External links