User-agent: * Disallow: /sohoadmin/ Disallow: /tCustom/ Disallow: /template/ Disallow: /pgm-email_friend.php Disallow: /pgm-form_submit.php Disallow: /pgm-* Disallow: /search.php Disallow: /phpinfo.php Crawl-delay: 30 User-agent: Mediapartners-Google User-agent: SemrushBot User-agent: SemrushBot-SA User-agent: YandexBot User-agent: MJ12bot User-agent: AhrefsBot User-agent: bingbot User-agent: BLEXBot User-agent: DotBot User-agent: UptimeRobot User-agent: DnyzBot Disallow: /