Test your robots.txt rules against specific URLs and user-agents.
Type or select. List updates from robots.txt. Defaults to '*' if blank.
Status:
Tested URL:
Tested User-Agent:
Reason:
Matching Rule (Line ):