Data Engineer | Databricks | Apache Spark Certified, Databricks Professional Certified, Delta Lake, Python | Azure, 2x Azure Certified | Powercenter | Hadoop
Hello! I'm Matheus Henrique Borges dos Santos, a dedicated Data Engineer from SΓ£o Paulo, Brazil. I specialize in building robust data pipelines and have a strong background in Computer Engineering from FIAP. I am passionate about using software engineering principles to solve complex data problems and optimize data processing.
Data Engineer at F1RST Technology March 2023 - Present
- Migration and Refactoring: Led the complete migration and refactoring of one of Brazilβs largest bank data pipelines from an on-premises Cloudera environment to Azure cloud technologies.
- Regulatory Compliance: Developed calculation engines for regulatory compliance, including New Default, IRB, and IFRS9.
- Medallion Architecture: Implemented the Medallion Architecture data model to design and optimize data pipelines.
- Data Vault Architecture: Deployed the Data Vault architecture with incremental data processing for reduced processed data without modification.
Junior Data Engineer at F1RST Technology April 2022 - March 2023
- Developed rules for data ingestion, treatment, and analysis processes for Santander Bank, one of the largest banks in Brazil and Spain.
Junior Big Data Engineer at BRQ Digital Solutions July 2021 - April 2022
- Provided Big Data services to Santander Bank, developing rules for ETL processes, data treatment, and analysis.
Bachelor of Computer Engineering at FIAP 2020 - 2024
- Apache Spark Developer - Databricks
- Databricks Data Engineer Professional - Databricks
- Datalakehouse Fundamentals - Databricks
- DP-900 - Microsoft
- AZ-900 - Microsoft
- Big Data - FIAP
- Linux Fundamentals - FIAP
- Python Language - FIAP
- Logic Programming - IMPACTA
- Advanced Microsoft Excel 2016 - SENAC
- Portuguese: Native
- English: Advanced
- Connect with me on LinkedIn
- Check out my projects on GitHub
- Email: [email protected]
- Python
- Databricks
- Delta Lake
- PySpark
- Spark/PySpark
- Python
- PyTest
- SQL
- Databricks
- Delta Lake
- Data Factory
- BMC Control-M
- Git/GitLab
- Informatica PowerCenter
- Docker
This README was generated with β€οΈ by Matheus Henrique Borges dos Santos