ofili / pyspark-template Goto Github PK
View Code? Open in Web Editor NEWStructured Streaming app that can read files from the local system folder as new files are added to the folder as stream data and apply all the operations on the new data and, finally, write the results in an output directory.
License: MIT License