#WWW5 # Rules for all user-agents to disallow certain files and folders User-agent: * Disallow: /404* Disallow: /500* Disallow: /*?ReturnUrl= Disallow: /*?redirectBackTo= Disallow: /*?sitedirectory= Disallow: /*?hawktoppager= Disallow: /App_Data/ Disallow: /App_Code/ Disallow: /App_Readme/ Disallow: /App_Start/ Disallow: /bin/ Disallow: /binary/ Disallow: /Build/ Disallow: /ClientBin/ Disallow: /Custom/ Disallow: /ftp/ Disallow: /Frontend-Assembly/ Disallow: /HawkSearch/ Disallow: /Lib/ Disallow: /Mvc/ Disallow: /obj/ Disallow: /packages/ Disallow: /Properties/ Disallow: /RedirectUploads/ Disallow: /Resources/ Disallow: /ResourcePackages/ Disallow: /search/ Disallow: /searchproxy/ Disallow: /Sitefinity/ Disallow: /Views/ Disallow: /WidgetDesigners/ # APICS.org specific rules Disallow: /ScormContentPlayerRemote/ Disallow: /docs/default-source/cbox-marketing-tools/ Disallow: /docs/default-source/cbox-general/ Disallow: /docs/default-source/cbox-membership-reports Disallow: /docs/default-source/cbox-partner-management Disallow: /cbox/ # Rules for all user agents to allow certain files and folders User-agent: * Allow: /Sitefinity/WebsiteTemplates/ Allow: /ResourcePackages/Talon/assets/dist/css/ Allow: /Frontend-Assembly/Telerik.Sitefinity.Frontend/assets/dist/css/ # Prevent certain bots from accumulating excessive search queries (9-20-18 crc) User-agent: dotbot Disallow: /*learning-opportunities?* Disallow: /*find-a-partner?* Disallow: /*search#* User-agent: rogerbot Disallow: /*learning-opportunities?* Disallow: /*find-a-partner?* Disallow: /*search#*