background img
May 31, 2020
144 Views
0 0

How to add Robots.txt file in Blog Step by Step Full Guide

Written by

Today I am going to tell you how to use robots.txt code in the blog. You must have tried it before, but the error will come, so today we learn to add it correctly, if you want to keep your blogging as well as privacy then it would be better to add robots.txt.

Robots.txt is a file blogger has added it to the blog so that we can hide some private things from its search engine like google with its help. Every post of this blog is on every page, whether you can hide it from search engines like google, bing, yahoo.

Also read:

How do robots.txt work?

Suppose robots.txt is the bodyguard of your website for a while. Now, whenever a user searches in a search engine on a topic related to our website, then the search engine comes to our website, then the bodyguard of your website means robot.txt Tells what is allowed to show him on this website. So, friends, this is how the robots.txt file protects the privacy of our website.

Also read:

How to create Robots.txt File for your Blog?

By the way, there are many websites that make robot.txt file for the blog but if it was true then think for a while blogger has not started this service to date. I would just like to tell you that you do not need to go anywhere. Here today I am giving you the code of robots.txt file which is mentioned by blogger, if you want, you can see it by going to the blogger help forum. If you want to see this, then click here for it.

1. User-agent: Media partners – Google

This is a Google Adsense robot, if you use AdSense code in your blog, then you can hide your code from the search engine by using it, if you do not use AdSense, then it is not necessary for you.

2. User-agent:

This is for all the users of your website, what should they see on your website, and whatnot, so let it remain dish so that the security of our blog remains.

3. Disallow: search

This code is for the keyboards of your website, we should not allow it for your website so that the search engine cannot show it. If you want then you can allow sdish here by putting the URL of any page, post or keyboard of your website here: –  https://checkwebsitedemo.com/

4. Allow:

Here, you can set what you want to show to the search engine, if you allow it to be allowed only then it will be good.

5. Sitemap

This is the most important sitemap that gives the search engine information about the new post of our website, when does it have to search, how many URLs are there in which post, which is the most popular, and also a lot of work is a robot in sitemap’s friend’s blog. Before adding a text file, you have to be a sitemap for your blog. You can create a sitemap for your blog by clicking here.

User-agent: Mediapartners-Google
 Disallow:
 User-agent:
 Disallow: /search
 Allow: /
 Sitemap: https://www.checkwebsitedemo.com/sitemap.xml

Copy this code.

Before copying, add a sitemap of your own website instead of https://www.checkwebsitedmo.com//sitemap.example.

How to Add Robots.txt File to Blog?

Step 1:

1. First, go to the blogger.com website.

 indexing

  1. Now go to the settings of Blog.
  2. Click on search preferences.
  3. Now click on edit in front of Custom Robots.text.

Step 2:

robots txt

  1. Please tick Yes.
  2. Paste the code given above here.
  3. Now you have to click on Save Changes.

Now the robots.txt file has been added to your blog, you will show any search engine that will allow you robot.txt file.

Note: – If you do not want to publish anything from your blog, then only add this robots.txt file to your blog. If you do not have to hide a page, post keyboard, a label from the search engine, then do not add robot.txt to your blog.

If you have any questions related to the robot.txt file, then you can ask in the comment.

I hope you will like this post, if yes then read more posts from our website and also share our post with all your friends on social media.

Article Tags:
Article Categories:
SEO

Leave a Reply

Your email address will not be published. Required fields are marked *


The maximum upload file size: 300 MB.
You can upload: image, audio, video, document, text, other.
Links to YouTube, Facebook, Twitter and other services inserted in the comment text will be automatically embedded.