A file that tells search engine crawlers which pages or files they can or cannot request from your site.
