# Greetings, bot author! # # Unless you are a search engine, you probably don't want to scrape this website by looking at its HTML. # Use the better option: send us an E-Mail and ask for API access. # It's faster, more reliable, and less labour-intensive. # # If you choose to ignore this advice and still go ahead to scrape HTML, be advised that visiting any part # of the website that this file declares disallowed or sending more than one request in three seconds is # neither endorsed nor supported by us, and that you will almost certainly run into problems if you try. # We will use technical measures to stop you, and even if you manage to bypass them, this website will # change, and your code will break at some point. If you use the API, this won't happen to you, both of us # save time and resources, and everybody is happy. User-agent: * Crawl-delay: 3 Disallow: /recent/ Disallow: /fetch/search/ Disallow: /fetch/recent/ Disallow: /search/ Allow: /search Disallow: /account/ Allow: /account