Hadoop1 and Hadoop2 cleanup files using s3 storage

By
Files in a HDFS file system can be configured to save files to a trash dir.  If your just using it as a file store you need to manually clean up all the files.  You can do this with the following HDFS command:

hadoop fs -Dfs.defaultFS=s3://myS3bucket -Dfs.trash.interval=0 -expunge

Comments

Post a Comment

Popular posts from this blog

Vim vi how to reload a file your editing

By
5.8. How do I reload/re-edit the current file? You can use the ":edit" command, without specifying a file name, to reload the current file. If you have made modifications to the file, you can use ":edit!" to force the reload of the current file (you will lose your modifications). For more information, read :help :edit :help :edit! :help 'confirm' from - http://vimdoc.sourceforge.net/cgi-bin/vimfaq2html3.pl#5.8
Read more