To avoid unwanted written content while in the lookup indexes, webmasters can instruct spiders not to crawl selected documents or directories with the typical robots.txt file in the root Listing of the area. In addition, a website page may be explicitly excluded from the online search engine's database by utilizing https://news.rafeeg.ae