Saturday, 9 January 2016

How to transfer data from Hadoop cluster to Azure Blob

Add following properties into core-site.xml

<property>
        <name>fs.azure.account.key.<@container name>.blob.core.windows.net</name>
        <value><account key value></value>
   </property>

And make access of blob as container in Azure Portal

Now We can transfer data from hadoop cluster to azure blob container.

hadoop fs - localpath  azure_blob_path

For transfering Hdfs to azure blob :

hadoop distcp hdfs://hostname:8020/filename  azure_blob_path

Azure Blob path can be  :

wasb://<containername>@<storageAccountName>.blob.core.windows.net

No comments:

Post a Comment