Sitemap: http://www.portugal-villa-holiday.com/IeEYFsYd.xml # robots.txt file # ====== INSTRUCTIONS ======= # created for portugal-villa-holiday.com # by R Rensch, www.rensch.com # # This is a special file that tells search engines which pages they should ignore. # It has a wildcard capability, but is very "dumb", # so be sure you understand what you're doing here, # or you could wind up disallowing your whole site! # (Use of this file is allowed but not supported by SBI! support.) # # For info on robot.txt files, see # http://info.webcrawler.com/mak/projects/robots/exclusion.html # # Here are the basics: # If there's a page you don't want to be spidered, list it in this file, using # this form... # Disallow: /example # where "example" is a file or directory name (a trailing slash is optional, depending # on your intention...see next, re wildcards), and the line starts with "Disallow" # (that is, don't include the "# "... everything after a # is comment.) # # IMPORTANT-- Robots.txt has only one type of wildcard capability... # ...there's ALWAYS a presumed * wildcard after whatever you type. # (Don't us an asterisk; it's considered just an asterisk.) # So, "/example/" # disallows: /example/anything.html # but allows: /example.htm # while "/example" # disallows: /example/anything.html # and disallows: /example.htm # and disallows: /example.txt etc. # Especially, don't just put "Disallow: /" because that would disallow everything! # # Blank lines are NOT okay, except to start a section intended for a different # user-agent (search engine). If you want a blank line, start it with a # comment symbol (#), like this: # # # ACTUAL ROBOTS.TXT CONTENT FOLLOWS: # User-agent: * # directed to all robots Disallow: /bkup- Disallow: /dupe- Disallow: /hold- Disallow: /libr- Disallow: /old- Disallow: /prvt- Disallow: /skip- Disallow: /temp- Disallow: /util- Disallow: /work- Disallow: /xtra- # end of file