robot.txt

User-agent: * Disallow: /my/ Crawl-delay: 3 Sitemap: https://xn----7sbhajeb0as3ahxhbbjdbt.xn--p1ai/sitemap.1709113.xml.gz User-Agent: Yandex Allow: / Disallow: /my/ Crawl-delay: 3 Host: https://xn----7sbhajeb0as3ahxhbbjdbt.xn--p1ai Sitemap: https://xn----7sbhajeb0as3ahxhbbjdbt.xn--p1ai/sitemap.1709113.xml.gz User-agent: msnbot Crawl-delay: 10 User-agent: MJ12bot Crawl-delay: 20 User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: /