zainulabidin302 / aws-glue-tutorial Goto Github PK

Create a glue script with cloud formation template

• 1.1. Create template bucket
• 1.2. Create source bucket
• 1.3. Create a iam role
• 1.4. Create a glue script

Write a shell-script

• 2.1 Read csv and write csv
• 2.2 Read huge csv and write huge csv

Write spark script

• 3.1 Read csv and write csv
• 3.2 Read huge csv and write huge
• 3.3 Tune DPUs
• 3.4 Understand Monitoring of jobs

Profile Glue script

• 4.1 Cost optimization with profile

Datalake formation with Glue

ApplyTransforms vs MLTransforms

LinearRegression with Glue

LogisticRegression with Glue

Everything IaC with Scpetre and CF