Web Robots, also known as Web Wanderers, Crawlers, or Spiders, are programs that traverse the web automatically. Search engines, such as Google or Yahoo, use them to index the web content of your site. However they can also be used inappropriately, such as spammers using them to scan for email addresses. The following are a few methods you can use to prevent this. The publishing of this information does not imply support of this article. This article is provided solely as a courtesy to our customers.
Why Would You Want To Stop Search Engines From Indexing Your Site?
Resources Blog. Search engines are the source for most traffic to a website on the Internet. However, there are times when you might not want sites like Google to crawl your content. In those cases, perhaps you want to prevent WordPress from being indexed in search results.
Why Discourage Search Engines from Indexing Your WordPress Site
For many websites, search engines are the largest source of traffic. And here are some reasons as to why you might consider how to discourage search engines from indexing this site of yours:. You can discourage search engines from indexing your website from within the WordPress dashboard. Go ahead and check the box that says Discourage search engines from indexing this site. Be sure to click Save Changes.
Site owners will do anything to get their websites indexed. Stick with us if you want to learn more about this topic! So how do you block search engines from indexing your site? Well, take a look at several options below and try it yourself.