Every year there are changes in the search engines, the crawlers become more efficient due to changes in the methods of analyzing information on sites.