Friday, 7 August 2015

HDFS Commands


hadoop fs -ls          

hadoop fs -ls /

hadoop fs -mkdir test     (Make directory)

hadoop fs -mkdir -p test/test2/test3    (Create directories at one go )

hadoop fs -rm -R test/test2        (Remove)

cd /root/devph/labs/Lab2.1/
tail data.txt

hadoop fs -put data.txt test/

hadoop fs -cp test/data.txt test/test1/data2.txt

hadoop fs -rm test/test1/data2.txt

hadoop fs -cat test/data.txt

hadoop fs -tail test/data.txt

hadoop fs -get test/data.txt /tmp/

hadoop fs -put /root/devph/labs/demos/small_blocks.txt test/

hadoop fs -getmerge test /tmp/merged.txt        (Merge all files under this dir and put them to local)

hadoop fs -D dfs.blocksize=1048576 -put data.txt data.txt   (Fix block size and dump)

hdfs fsck /user/root/data.txt    (File system check-- No of blocks check)

No comments:

Post a Comment