dumpfshadoop's Introduction

DumpFSHadoop

Introduction

This proof of concept Java application enables the dumping of Android partitions (or embedded Linux device partitions), compression and transfer over a network and onto a Hadoop HDFS cluster. This application is part of the LEIA system.

Assumptions

The Android device is rooted, or one has some sort of privileged access in order to initiate the 'dd' command.
That 'busybox' is installed on the Android device/embedded Linux device
- ('busybox' contains 'dd' if the OS doesn't have it already)
That there is an SSH server on the device allowing the HDFS Storage node to initiate an SSH connection to the device
That the devices are on the same local network
- (Although the testing we did was over the Internet over a VPN connection)
That a HDFS cluster is present to store the incoming dumped 'dd' file

Testing

Testing has been done using the following devices (... in reverse order):

Google Nexus 5 - Android 5.1.1
Samsung Galaxy S4-I9506-LTE - Android 5.1.1
Samsung Galaxy Tab 2 - Android 4.0.3
HTC Incredible S - Android 2.3.3
HTC MyTouch 4G Slide (MT4GS) - CyanogenMod
Chumby (Legacy embedded Linux device)

Attribution

This work was done by Irvin Homem as part of his Master's Thesis at KTH - The Royal Insitute of Technology (Stockholm, Sweden), and expanded on in some of his doctoral publications at Stockholm University.

Recommend Projects