On the Use of Web Search to Improve Scientific Collections

Krutarth Patel, Cornelia Caragea, Sujatha Das Gollapalli

First Workshop on Scholarly Document Processing (SDP 2020) Workshop Paper

You can open the pre-recorded video in a separate window.

Abstract: Despite the advancements in search engine features, ranking methods, technologies, and the availability of programmable APIs, current-day open-access digital libraries still rely on crawl-based approaches for acquiring their underlying document collections. In this paper, we propose a novel search-driven framework for acquiring documents for such scientific portals. Within our framework, publicly-available research paper titles and author names are used as queries to a Web search engine. We were able to obtain ~267,000 unique research papers through our fully-automated framework using ~76,000 queries, resulting in almost 200,000 more papers than the number of queries. Moreover, through a combination of title and author name search, we were able to recover 78% of the original searched titles.
NOTE: Video may display a random order of authors. Correct author list is at the top of this page.