hadoop - Shell Script to copy directories from hdfs to local -


i'm looking shell script should copy directory (with files under) hdfs local system.

i think pointless write whole script, when need write 1 command terminal. with

hadoop fs -ls /mydir/path 

you can verify name , path directory, want copy , write

hadoop fs -get /mydir/path 

to file local. can specify destination directory by

hadoop fs -get /mydir/path /mylocal/destdir 

it copies while directory (with subdirectories) working directory or specified directory. can file file (dir dir) with

hadoop fs -get /mydir/path/*  

or specific dirs or files in 1 command

hadoop fs -get /mydir/path/dir1 /mydir/path/dir2 . 

to directory. tried on hadoop vm , works fine.


Comments

Popular posts from this blog

javascript - Chart.js (Radar Chart) different scaleLineColor for each scaleLine -

apache - Error with PHP mail(): Multiple or malformed newlines found in additional_header -

java - Android – MapFragment overlay button shadow, just like MyLocation button -