This repo is for the final project of Fall 2019 EECS 6893 BIG DATA ANALYTICS course in Columbia University, contributed by Hongbo Du(hd2452), Jiajia Chen(jc5029), Yuqin Xu(yx2478).
- Shallow clouds is an important indication of Earth’s climate. However, they are difficult to represent in climate models due to various and murky organizations.
- Build better models to classify cloud organization patterns. And understand how clouds will shape our future climate.
- Python, Spark SQL: preprocess data
- GCP compute engine, U-Net: Image Segmentation Model
- Flask, Google Data Studio, BigQuery: Interactive Website