DEV Community

shubham mishra
shubham mishra

Posted on

Hadoop hdfs

The File System (FS) shell includes various shell-like commands that directly interact with the Hadoop Distributed File System (HDFS) as well as other file systems that Hadoop supports, such as Local FS, WebHDFS, S3 FS, and others. The FS shell is invoked by:

**Hadoop HDFS Commands
**Most of the commands in FS shell behave like corresponding Unix commands. Differences are described with each of the commands. Error information is sent to stderr and the output is sent to stdout.

If HDFS is being used, hdfs dfs is a synonym. Relative paths can be used. For HDFS, the current working directory is the HDFS home directory /user/ that often has to be created manually. The HDFS home directory can also be implicitly accessed, e.g., when using the HDFS trash folder, the .Trash directory in the home directory.

We will start with some very basic help commands and go into more detail as we go through this lesson.

  • fsck
  • ls
  • mkdir
  • touchz
  • du
  • cat
  • text
  • copyFromLocal
  • copyToLocal
  • put
  • get
  • count
  • rm
  • rm -r
  • cp
  • mv
  • expunge
  • rmdir
  • usage
  • help

Top comments (0)