A robots.txt file tells search engines whether or not they can entry and as a consequence crawl portions of your site. This file, which has to be named robots. All sites have a home or root page, which is usually the most frequented page about the site plus the starting http://www.worlds-best-web-designer.com