If you are a blogger then you must know the importance of indexing a blog to search engines. You must let index search engines like Google, Yahoo, and Bing etc. to get huge traffic from search engines. When you don’t see any traffic to your blog from search engines then there is something wrong happen and you must check it. You need to know how to allow search engines to index your blog that you can do several ways.
Now-a-days. Most of the bloggers and webmasters use WordPress CMS to build, run and maintain their blog. So, when you use WordPress, you can easily allow search engines to index your blog. Let’s see how you can do it.
Proper Privacy Setting
When you install WordPress, you need to change some essential settings from your blog admin panel. To allow search engines to crawl and index your blog, you need to configure search engines settings. To configure this, login to your blog admin panel Dashboard.
Then go to Setting >> Reading >> Search Engine Visibility
Make Sure the Discourage search engines from indexing this site option is disable and Click Save. (See the Image Below.)
Make Sure Your Blog Robots.txt File Properly Configured
Robots.txt file is most important for a website/blog where webmasters tell search engines to index their site/blog. You must create a well formatted Robots.txt file and upload it on your server root folder. If you’re using WordPress, then you can create a Robots.txt file using WordPress SEO by Yoast plugin and don’t need to upload it to root folder manually.
Sample of a Well Formatted Robots.txt File for WordPress Blog
User-agent: *
Disallow: /cgi-bin/
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /recommended/
Disallow: /comments/feed/
Disallow: /trackback/
Disallow: /index.php
Disallow: /xmlrpc.php
User-agent: Googlebot-Image
Allow: /wp-content/uploads/
User-agent: Mediapartners-Google
Disallow:
User-agent: Googlebot-Mobile
Allow: /
Sitemap: https://www.yourdomain.com/sitemap_index.xml
Bonus Tips to Get Index Your Blog Quickly
Submit Your Blog to Different Search Engines: This is one of the most popular and easiest way to index your blog quickly. Verify your blog in Google and Bing using webmaster tool. You can also submit your blog links to others top search engines manually.
Blog Design: Use SEO friendly WordPress Template that helps to crawl and index your blog faster.
Update Your Blog: It is also most important, especially for new blog. You must update your blog on a regular basis by posting new content to your blog.
Use Social Bookmarking and Networking Sites: When you publish a new post on your blog, then share this link on popular Social Networking Sites and Social Bookmarking Sites like Facebook, Twitter, Google+, Pinterest, Reddit, Stumbleupon, Delicious, Digg, Scoop It etc.
Comments on Others Blog: Drop some valuable comments to others blog that’s niche related to you. It is also important to drop comment in Good Alexa Rank, High Domain Authority and Page Authority Blog.