Welbert Hime's Projects
Airflow 2.0 configuration with Celery Executor based on Docker containers with Postgres and Redis broker plus Flower and Webserver UI
A visualization of ANAC open database builded with Apache Airflow, PySpark, Docker, Terraform and GCP
Event driven data pipeline processing data from S3 to Athena with Lambda functions, SQS queues, Glue metastore/jobs
Football scouts from Cartola FC at a data lake with data warehouse and dashboard
The classic cats and dogs image classification with Keras and Tensorflow
Covid19 and Iowa Liquor Sales analysis at BigQuery using dbt, Airflow, Marquez, Google Cloud and other modern data stack tools
Streaming change data capture from SQL Server to MongoDB, Redis and Hadoop with Debezium and Spark Streaming
Infrastructure of Airflow with Celery workers builded with Terraform resources based on GCP Compute Engine VM Instances
Silly extraction and parsing of data from Github API to sinks like Console, File, MongoDB and Kafka
Minimal landing page for developers
Ifood data wrangling with Apache Airflow and Apache Spark running on Kubernetes
Hardware description of a JVM with a reduced set of instructions implemented in VHDL
Apache Airflow helm chart environment running on local kubernetes (kind) with docker abstraction
Functional programming fundamentals with Scala and Cats =^.^=
A project to store my fundamentals study in Scala
Sentiment analysis with pre trained FastText model, with a Flask API and multiple deploy options in Google Cloud
Extraction and data wrangling from Twitter API with Apache Airflow, PySpark and DeltaLake
BigQuery data ingestion using PubSub and Cloud Functions
YOLO-Tiny and YOLO-Tiny + XNOR-Net person detection with Pascal VOC 2007 and 2012 datasets
INMET weather data extraction, structuring and visualization with Docker, Apache Airflow, BigQuery and Apache Superset.
Weather data ingested in Kafka broker and processed with Spark Streaming
A set of hardware architectures to build a co-design of convolutional neural networks inference at FPGA devices