User-agent: * Disallow: /wps/myportal/* Disallow: /wps/portal/* Disallow: /intl/* Disallow: /intl/* Allow: /intl/about/* User-agent: gsa-crawler Allow: /intl/* Allow: /intl/* User-agent: Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.1; WOW64; Trident/6.0) Allow: /intl/* Allow: /intl/* User-agent: Swiftbot Allow: /intl/* Allow: /intl/*