Google posts draft to formalize Robots Exclusion Protocol Specification

Google open sources its robots.txt parser as part of this announcement.

Please visit Search Engine Land for the full article.

from Search Engine Land: News & Info About SEO, PPC, SEM, Search Engines & Search Marketing https://ift.tt/2YqNzQP via اصول سيو