To prevent unwanted articles from the look for indexes, webmasters can instruct spiders not to crawl particular files or directories with the standard robots.txt file in the foundation Listing of your area. Moreover, a website page might be explicitly excluded from a search engine's database by using a meta tag https://www.facebook.com/acourseinmiraclesdavid/