Robots

This is the robots.txt setup page. Edit the content of the generated robots.txt file in Page Properties.

#
# robots.txt
#
# This file is to prevent the crawling and indexing of certain parts
# of your site by web crawlers and spiders run by sites like Yahoo!
# and Google.By telling these robots where not to go on your site,
# you save bandwidth and server resources.
#
# This file will be ignored unless it is at the root of your host:
#
# For more information about the robots.txt standard, see:
# http://www.robotstxt.org/robotstxt.html
#
# IMPORTANT: 
# Create new rules using the names of the pages of your location/language
# site. For example, in USA/English, "Allow: /Frequently-asked" or "Disallow: /content/qa/coca-cola/error".
# Always create rules for pages that already exists in your location/language site. 
# Rules in other languages will not be applied to your location/language pages.

# User-agents

User-Agent: *
Disallow:
Sitemap: http://preguntasyrespuestas.coca-cola.com/sitemap.xml

# Pages allow and disallow 

# Include new lines starting with "Allow:" or "Disallow:" to include new rules.