# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-agent: * Crawl-delay: 120 Disallow: /layouts/ Disallow: /holds/select_hold/ Disallow: /item/report_match/ Disallow: /info/select_library/ Disallow: /monitor/ Disallow: /item/digital_availability/ Disallow: /item/show_circulation_widget/ Disallow: /item/get_external_content/ Disallow: /item/full_record/ Disallow: /collection/add/ Disallow: /bib/match/ Disallow: /list/new/my/ Disallow: /dashboard/browse/shelf_browse Disallow: /item/show_circulation/ Allow: /* Allow: /sitemap.xml Sitemap: https://sppl.bibliocommons.com/sitemap User-agent: Yandex Disallow: / User-agent: YandexBot Disallow: /