# Disallows all robots except those for major search sites # http://www.robotstxt.org/wc/exclusion-admin.html User-Agent: * Disallow: /s/load_tags/ Disallow: /s/async/ Disallow: /metrics/async/ Disallow: /uv/ Disallow: /m/profiles/site/ Disallow: /referrals/compare/ Disallow: /referrals/sites/