hadoop - Shell Script to copy directories from hdfs to local -
i'm looking shell script should copy directory (with files under) hdfs local system.
i think pointless write whole script, when need write 1 command terminal. with
hadoop fs -ls /mydir/path
you can verify name , path directory, want copy , write
hadoop fs -get /mydir/path
to file local. can specify destination directory by
hadoop fs -get /mydir/path /mylocal/destdir
it copies while directory (with subdirectories) working directory or specified directory. can file file (dir dir) with
hadoop fs -get /mydir/path/*
or specific dirs or files in 1 command
hadoop fs -get /mydir/path/dir1 /mydir/path/dir2 .
to directory. tried on hadoop vm , works fine.
Comments
Post a Comment