Git Product home page Git Product logo

hdfstree's Introduction

HDFSTREE

This is a simple standalone tool that emulates the Unix 'tree' command in HDFS.

USAGE

To use it just copy the tool, add it to your path it's ready to use, it has 3 options:

  • -p: Specifies the root path. This is mandatory.
  • -l: Specifies that you want to use the local filesystem instead of HDFS:
  • -s: Specifies that you want to see the size (in human readable format) next to each directory.
  • -d: Specifies the maximum depth when displayin the tree.

some examples:

hdfstree -p /
This will print all the HDFS tree. This will take some time...

hdfstree -p /user/marc/ 
Print all the directories starting from /user/marc

hdfstree -l -p /Users/marc/Music -s 
Print all the directories in the /Users/marc/Music directory in the local filesystem and display the sizes. 

The output is pretty much like the unix tree command. Have an example:

└──/Users/marc/work/hdfstree
    ├──.git
    |   ├──branches
    |   ├──hooks
    |   ├──info
    |   ├──logs
    |   |   └──refs
    |   |       ├──heads
    |   |       |   └──mdepalol
    |   |       └──remotes
    |   |           └──origin
    |   ├──objects
    ...

BUILDING & SOURCE

Build is done with gradle. To create a ready to use script with the libraries just use:

gradle installApp

You'll get the executable script + the libraries in

hdfstree/build/install/hdfstree

just add this directory (hdfstree/build/install/hdfstree/bin) to your PATH variable and you are done, also, make sure you have the HADOOP_HOME environment variable set. The program will complain if you don't have it.

hdfstree's People

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

hdfstree's Issues

Add 'depth' option.

Adds an option to limit the depth of the displayed tree. A la '-L' in tree.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.