# robots.txt for http://www.clearonehp.com/ # This file will disallow robots (i.e. crawlers, indexers and spiders) from crawling unneccessary or disallowed content User-agent: * Allow: / Disallow: /Admin/ # Self-explanatory Disallow: /eo_web.ashx # Essential Objects web handler #Disallow: /GSAJump.aspx # GSA jump page for orphaned links Disallow: /Errors/ # Error pages Disallow: /Editor/ # FCKEditor Disallow: /ScriptResource.axd* # ScriptResource Disallow: /Scripts/ # Javascript files Disallow: /Styles/ # CSS stylesheets Disallow: /WebResource.axd # Web resource file Disallow: /WebServices/ # Web Services Disallow: /Index.aspx* # Old portal landing page Disallow: /Secure/IndividualInsuranceManager/ # Individual Insurance Manager Disallow: /Secure/Members/ # Secure members area Disallow: /Secure/PostForms/ # SSO Disallow: /Secure/QuoteSystem/ # Quote System Disallow: /Secure/QuoteSystem_PreHB2002/ # Quote System Pre-HB2002 User-agent: NextGenSearchBot Disallow: /