This template is a personal collection of boilerplate code and utility scripts for a Python project with Apache Spark. I personally do not recommend using this script for anyone else, especially in production, as I am not a professional engineer and primarily use this repository to test out random ideas and experiments.

• Dataset files
• Jupyter notebooks
• Project source code
• Project unit tests
• Common utility scripts
  • General purpose utilities
  • Machine learning
  • Natural language processing

TODO: add a Makefile with setup scripts.

It's a personal project, after all, but I would appreciate any suggestions.

Use it to instantly create Pyspark environment for testing purposes.

No license.