Steven Hawkins created TEIID-5993: ------------------------------------- Summary: Add robots.txt to better crawl content Key: TEIID-5993 URL: https://issues.redhat.com/browse/TEIID-5993 Project: Teiid Issue Type: Quality Risk Components: Documentation Reporter: Steven Hawkins Assignee: Steven Hawkins We should do a better job of directing what pages are crawled. I added a robots.txt to prevent the crawling of legacy. Something similar should be added for teiid.github.com to allow only the crawling of master. -- This message was sent by Atlassian Jira (v7.13.8#713008)