What is a Robots.txt file? As we all know, search engine bots play the most prominent role in fully introducing a site to search engines. As the biggest reference and the most extensive network in…