[ARCHIVED] Noindex tag - Hide pages from search engines

[jmsmit49]

In the instance of catalog I use, we often create a lot of custom catalog pages for potential clients (often corporate) that need to truly stay private and hidden from search engines. 

My team identified that in order to hide certain pages from search engines, we need access to the robots.txt file. We can add “noindex” to the meta tag with JS but a search engine will not see it as they ‘scrape’ the html on the page/never loading the JS.

After asking some questions, I learned that it is not currently an option to configure robots.txt file. 

Has anyone had the need to hide catalog pages from search engines, and if so, have you found a work around? This is an extremely important feature we would like to figure out a solution for.

[jsowalsk]

We have not done this but we would love to find a way to do this and restrict access from links that have been placed on websites.