# If the Joomla site is installed within a folder # eg www.example.com/joomla/ then the robots.txt file # MUST be moved to the site root # eg www.example.com/robots.txt # AND the joomla folder name MUST be prefixed to all of the # paths. # eg the Disallow rule for the /administrator/ folder MUST # be changed to read # Disallow: /joomla/administrator/ # # For more information about the robots.txt standard, see: # http://www.robotstxt.org/orig.html # # For syntax checking, see: # http://tool.motoricerca.info/robots-checker.phtml User-agent: * #THIS ALLOWS FULL RENDER AT ENGINES Allow: /*.js*************** Allow: /*.css************** Allow: /*.png************** Allow: /*.jpg************** Allow: /*.jpeg************** Allow: /*.gif************** Allow: /*.eot************** Allow: /*.woff************** Allow: /*.ttf************** Allow: /*.svg************** Allow: /*.otf************** Allow: /*.pdf************** Allow: /*.PNG************** Allow: /*.JPG************** Allow: /*.JPEG************** Allow: /*.mp3************** Allow: /*.pdf************** Allow: /*.webp************** # 4SEO-opt Disallow: /cache/ # THESE FOLDERS SHOULD NEVER BE CRAWLED Disallow: /administrator/ Disallow: /includes/ Disallow: /installation/ Disallow: /language/ Disallow: /libraries/ Disallow: /logs/ # Disallow: /flowsocialmedia.com/ Disallow: /layouts/ Disallow: /libraries/ Disallow: /___DELETE____oldcwcsite/ Disallow: /___DELETE____newcwcsite/ Disallow: /tmp/ Disallow: /ampztesting/ Disallow: /developmentcwc/ #SEO Testing To Block Random Pages With Variables Disallow: /?types* Disallow: /?pages* Disallow: /?format* Disallow: /?limit* Disallow: /page-*/ Disallow: /component/tags/ Disallow: /*feed* Disallow: /*rss* Disallow: /*wp-content* # Disallow: /tmp/ # 4SEO-sitemap: sitemap - added on 2022-07-01 06:50:33 - Please do not modify manually. Sitemap: https://cruisewestcoast.com/sitemap-4seo.xml User-agent: * Allow: /sitemap-4seo # /4SEO-sitemap #