docker-spark-jupyter-scala's Introduction

Apache Spark + Miniconda + Scala kernel for Jupyter on Docker

This docker image is based on this spark-Miniconda docker image, which additionally includes some useful data science tools:

Pull the image from Docker Repository

docker pull aghorbani/spark-jupyter-scala

Build the image

docker build --rm -t aghorbani/spark-jupyter-scala  .

Running the image

docker run -it -p 8088:8088 -p 8042:8042 -p 4040:4040 -p 8888:8888 -h sandbox aghorbani/spark-jupyter-scala

Store your notebooks in a local volume

docker run -it \
           -v /path/to/local/notebooks:/notebooks \
           -p 8088:8088 -p 8042:8042 -p 4040:4040 -p 8888:8888 \
           -h sandbox \
           aghorbani/spark-jupyter-scala

In the above command please replace /path/to/local/notebooks to your local volume, where you would like to have the notebooks.

For further details on the spark part of this image have a look here.

docker-spark-jupyter-scala's People

Contributors

Watchers

docker-spark-jupyter-scala's Issues

how to store the notebooks locally on my hard disk?

I would like to store the notebooks locally on my hard disk.

In simpler types of containers I've used volumes and mapped them on my physical disk.

Would you be so kind to recommend an approach, or better add the appropriate command to the README file?

Thanks in advance

(take into account that the links to Spark on the existing README are broken)

Token / Password Auth

How do I force the Jupyter install to ask for a token/password?
Tried modifying jupyter-notebook.sh with command line args and tried to put a jupyter_notebook_config.py in /root/.jupyter/ but it never works.

Recommend Projects