Using Robots.Txt to Hide Azure Blob Storage Data from Search Engines

Hello,

What if you want to make an Azure Blob storage container public so that you can quickly share data with someone – but don’t really want the rest of the world to discover that it’s in place? A simple approach would be to drop a robots.txt file in the directory with the following contents inside:

User-agent: *
Disallow: /

This will ensure that the directory isn’t crawled by search engines – which will reduce the risk of exposing the data to unwanted parties.

- Ira Bell

Tagged with: , , , ,
Posted in .NET Framework, Azure Blob Storage, Ira Bell, New Jersey, New York City, Nimbo Headquarters, Windows Azure

        

Nimbo is a cloud services provider bringing you cloud news, technical resources and strategy tips. More at www.nimbo.com

Join the Cloud Team
Categories
Our Regular Contributors