# Allowing only verity k2spider to crawl the policy directory User-agent: k2spider Disallow: # Preventing all search engines from crawling the policy directory User-agent: * Disallow: /policy/