User-agent: * Disallow: /*/mcd Disallow: /*/search/?* Disallow: /*/clients User-agent: SemrushBot Disallow: / User-agent: SiteAuditBot Disallow: / User-agent: SemrushBot-BA Disallow: / User-agent: SemrushBot-SI Disallow: / User-agent: SemrushBot-SWA Disallow: / User-agent: SplitSignalBot Disallow: / User-agent: SemrushBot-OCOB Disallow: / User-agent: SemrushBot-FT Disallow: / User-agent: RyteBot Disallow: / User-agent: SemrushBot-ESI Disallow: / Sitemap: /sitemap.xml