Add following properties into core-site.xml
<property>
<name>fs.azure.account.key.<@container name>.blob.core.windows.net</name>
<value><account key value></value>
</property>
And make access of blob as container in Azure Portal
<property>
<name>fs.azure.account.key.<@container name>.blob.core.windows.net</name>
<value><account key value></value>
</property>
And make access of blob as container in Azure Portal
Now We can transfer data from hadoop cluster to azure blob container.
hadoop fs - localpath azure_blob_path
For transfering Hdfs to azure blob :
hadoop distcp hdfs://hostname:8020/filename azure_blob_path
Azure Blob path can be :
wasb://<containername>@<storageAccountName>.blob.core.windows.net
No comments:
Post a Comment