How To Enable Custom Robots.Txt File Inward Blogger

Robot.txt is a agency to say search engines whether they are allow to index a page inward the search effect or not. The bots are automatic, in addition to earlier they could access your site, they cheque the Robot.txt file to brand certain whether they are allowed to crawl this page or not.   Sometime, people produce non desire to stop searching engine from crawling their whole website. On the other hand, they desire to specify few pages, which should non hold out indexed inward the search results. Therefore, today inward this article, nosotros volition demo you lot How to Enable Custom Robot.txt File inward Blogger?

First of all, larn to Blogger.com >> your site >> Settings >> Search engine Preference >> Crawlers in addition to indexing. Now you lot volition hold out able to encounter 2 options i.e. Custom robots.txt in addition to Custom robots header tags. These 2 options would furnish you lot the flexibility to customize your robot.txt file. 

• Custom robots.txt: This choice provides you lot the mightiness to edit your whole robot.txt file. You tin simply type your content whether you lot desire the content to hold out crawled past times spiders or not. However, You tin ever undo your actions in addition to tin ever revert dorsum to normal. 

• Custom robots header tags: This choice is a chip completed. It does non furnish you lot the mightiness to write your codes instead it provides few options alongside the cheque boxes. So, if convey no visit close caput tags thus remain away from it. 

Now you lot convey to enable the custom robot.txt file thus press the edit push which is acquaint side past times side to the “Custom robots.txt” option. After selecting the edit button, it would inquire you lot to enable custom robots.txt content thus press “Yes” in addition to transcend away on to the side past times side step. 

In the text area, type the content which you lot desire to exclude from existence crawled. After editing the file according to your needs, press the relieve push to conclude. However, if you lot desire to revert dorsum to the default robot file then, you lot tin choose “No” instead of “Yes. 

For Example:

User-agent: *
Disallow: /about

User-agent: *
Disallow: /contact

User-agent: *
Disallow: /services

We promise this tip would attention you. If you lot are having whatever number regarding crawling then, experience costless to operate out your questions inward the comments below in addition to our experts would endeavor to attention you lot inward solving them.