Why Robot.txt file is used?

- Online Exam Test Papers | - MCQs[multiple choice questions and answers ] | - Mock Test Papers | - Practice Papers | - Sample Test Papers |

Question:
Why Robot.txt file is used?

1.To block the crawler from crawling a particular portion of the website

2.To block Home page of the website

3.To Pass link juice when given link in other website

4.None of the above


More MCQS Questions and answers

R4R Team
R4Rin Top Tutorials are Core Java,Hibernate ,Spring,Sturts.The content on R4R.in website is done by expert team not only with the help of books but along with the strong professional knowledge in all context like coding,designing, marketing,etc!