User-agent: * Disallow: /wp-admin/ Allow: /ads.txt Allow: /wp-includes/ Allow: /wp-content/plugins/ Allow: /wp-content/themes/ Allow: /wp-content/uploads/ Disallow: /search Disallow: /?s= Allow: /feed Disallow: /comments/feed Allow: /feed/$ Allow: /*/feed/$ Allow: /*/feed/rss/$ Disallow: /*/trackback/$ Allow: /*/*/feed/$ Allow: /*/*/feed/rss/$ Disallow: /*/*/trackback/$ Allow: /*/*/*/feed/$ Allow: /*/*/*/feed/rss/$ Disallow: /*/*/*/trackback/$ Disallow:/ cgi-bin User-agent: NinjaBot Allow: / User-agent: Mediapartners-Google* Allow: / User-agent: Googlebot-Image Allow: /wp-content/uploads/ User-agent: Adsbot-Google Allow: / User-agent: Googlebot-Mobile Allow: / Sitemap: http://amorfm.mx/sitemap_index.xml User-agent: grapeshot Disallow: User-agent: grapeshot Disallow: User-agent: Doubleverify Disallow: User-agent: White ops Disallow: User-agent: moatbot Disallow: User-agent: ias_crawler Disallow: User-agent: forensiq Disallow: User-agent: duckduckbot Disallow: User-agent: Leikibot Disallow: User-agent: Baidu-YunGuanCe-ScanBot(ce.baidu.com) Disallow: User-agent: Baidu-YunGuanCe-SLABot(ce.baidu.com) Disallow: User-agent: Baidu-YunGuanCe-PerfBot(ce.baidu.com) Disallow: User-agent: Baidu-YunGuanCe-VSBot(ce.baidu.com) Disallow: # Good bots whitelisting: User-agent: Twitterbot Disallow: User-agent: Mediapartners-Google Disallow: User-agent: Facebot Disallow: #Other bots #Neticle Crawler v1.0 ( http://bot.neticle.hu/ ) https://bot.neticle.hu/ - brand monitoring #Mega https://megaindex.com/crawler - link indexer tool (supports directives in user-agent:*) #Obot - IBM X-Force service #SafeDNSBot (https://www.safedns.com/searchbot)