# Disallow all crawlers access to certain pages. User-agent: * Disallow: /demos/samples Disallow: /cgi-bin Disallow: /App_Code Disallow: /App_Data Disallow: /avisos # Sitemap files pending