In the last post I showed a video that mentioned using a robot.txt file but it didn’t explain how to make that file. Here is a site that discusses how to create a robot.txt file and explains exactly what it is and why you need one.
If you are not comfortable uploading files to your site using an FTP program, then skip this. Don’t try it yet.
If you are comfortable with an FTP program and have done some basic coding, then give this a try. A lot of Internet marketers encourage the use of a robot.txt file for SEO.
The alternative to using this file is putting rel=”nofollow” in all the links that you do not want the robots following. That can be a hassle. It’s easier just to place a robot.txt file on your site and include a few folders that you don’t want the robots going into.
Here’s the link where you can find the tutorial on creating your own robot.txt file: Robot.txt Tutorial
ftp internet marketers nofollow robot.txt file seo
yup, robot.txt is very important for SEO, especially to ‘guide’ the web crawler how to ‘crawl’ you site by your way you like.