Adding a noindex tag to a web page means Google and other search engines will not include it in their index. The noindex tag looks like this: <meta name="robots" content="noindex">.
The noindex tag can be useful to exclude certain pages from the search results.
An alternative way to noindex a page is by including noindex instructions in the HTTP headers of the page: X-Robots-Tag: noindex.
It's also possible to exclude specific search engines. replace robots with googlebot or googlebot-news to exclude those specific crawlers.
Crawlers will not index a noindexed page, but may still follow links on the page. If you want to avoid that too, use this tag: <meta name="robots" content="noindex,nofollow">Back