.Google.com confines robots.txt assistance to 4 industries, clarifying its own posture on in need of support regulations.Google.com just assists four details robots.txt fields.In need of support directives in robots.txt will definitely be actually disregarded.Look at bookkeeping your robots.txt documents in light of this update.