To stopsearch engine web crawlers from including your site page in their search engine index, place the following meta tag into the
<head> section of your page:
<meta name="robots" content="noindex">
The alternative method is a HTTP response header:
HTTP/1.1 200 OK (…) X-Robots-Tag: noindex (…)
For the noindex directive to take effect, the URL must not be blocked by a robots.txt file, and it must be otherwise accessible to a crawler. If the page is blocked by a robots.txt or is otherwise inaccessbile to crawlers, then Googlebot and other search engines will never see the noindex directive. Additionally, the page could still appear in search results especially if other pages link to it.