THE DEFINITIVE GUIDE TO ROBOTS.TXT

This is a good time to talk about the "long tail" of keyword research, and the 80/20 rule. Only about 20% of the keywords people search for will be popular "fat head" terms. The majority of keyword phrases will be less-frequent, long-tail keywords.The best way to avoid orphaned pages is to simply ensure that important pages are linked to, either vi