Noindex checker

Check if a page can be crawled and indexed