Just a tiny seed of develop hadoop + spark.

git clone --recurse-submodules [email protected]:yuikns/iphigenia.git

It is managed by sbt. You can import it into IntelliJ.

You can add some more packages via mvnrepository, copy and paste the path into project/BuildIphigenia.scala

After finish your developing, you can use script

scripts/pack

and get .jar(in this case is target/scala-2.11/cse8803-0.0.1-2.11.8.jar, may be changed based on your change in configuration) package contains all the dependencies.

if you are a windows user, please type the above command instead:

sbt assembly

This is just a small seed to help you quickly initialize a project for course, you can post issue if you have any questions. DO NOT upload the real code for you homework.