Git Product home page Git Product logo

Portfolio Images

Hi, I'm a Senior Software Engineer working for DSI Data Science Institute. I'm currently allocated to the Internet Equity Initiative (IEI) as a Backend/Data Engineer. I have +20 years of working on Computer Networks with experience in Security, HPC, and Mobile. Recently, I've been shifting the gears for everything's Data and Education, BI, and Decision-making processes. My latest project is running at https://beadchallenge.org with a serverless backend.

Instead of a wordy Resume, here's a more relaxed collage of images with important documentation of my work as most of it is open source. Also, check out my latest work on UI dashboarding IEI Netrics data on https://tigerteam.io.


image
Figure 1. This is the Netrics backend stack I'm responsible for. Some of this is WIP but most have been in prod for 3 years and crossed the 1 billion data-point mark of encrypted data. The stack includes small Golang data collection applications, python IaC (Serverless AWS code), terraform code, SQL database schema, parallel Python data ingestion, Kafka producer/consumers.


image

Figure 2. Aggregated average latency (active unloaded ICMP) for all Netrics deployed devices in Chicago city. As expected: fiber tech has lower latency. Data warehoused on TimescaleDB, image extracted from Superset BI tool. Estimated devices deployed: 120 in Chicago area. We benchmark the internet for ISPs to ensure internet consumers are getting a fair performance from their contracted services.


image

Figure 3. A Netrics Grafana dashboard with fluctuation on both latency and speed test. High-performance multiplayer games must have Netrics installed and keep an eye on their performance over time.


image

Figure 4. Campus deployment of Netrics, showing high latency for an outlier (Booth School). Image extracted from Looker Studio.


Figure 5. BEADChallenge.org analytics, where the internet speeds are lower (underserved) in IL, USA?


portifolio_analytics1

Figure 6. Data analysis work for the Internet Equity Initiative group. Does the low-income population have worse internet performance than the high-income? What does it mean to be an underserved or unserved area regarding broadband infrastructure? Is the broadband evolving in the US (2019 - 2021 comparison)?



Video 1. Netrics Passive in action (aka NetMicroscope). Software implemented in C with libwebsockets, libpcap, html, javascript, jquery, chartjs.
[WSJ Study](https://www.wsj.com/graphics/faster-internet-not-worth-it/)

image


image

Figure 7. Netrics Passive Schematics developed circa 2015. A $200 kit (Jetson Nano 472 GFLOPS) for high-performance passive packet capture, network monitoring and ML inference.


image

Figure 8. My earlier work (circa 2009-2011) on Deep Packet Inspection (DPI) for Alcatel-Lucent, programming CloudShield/IBM equipment (PacketC / C ). I was the principal engineer for the protocol/app service detection intelligence of the network traffic control engine called Agya. The solution was deployed in the Latin America region, mainly in Brazil.

A few of my certificates:

image image image image image image

Guilherme Martins's Projects

iotmmgmt icon iotmmgmt

Minimalist Internet of Things Management

iotpro icon iotpro

Serverless Application for IoT Device Managing and Profiling

kmeans icon kmeans

kmeans clustering with multi-GPU capabilities

labapp icon labapp

Web Application Portal for IoT Lab resources access

pcapwebapp icon pcapwebapp

Simple Django WebApp to command TCPDUMP process in Linux

pyod icon pyod

A Comprehensive and Scalable Python Library for Outlier Detection (Anomaly Detection)

react icon react

react building blocks components and examples

resources icon resources

Using data tables for curation of resources

resources-1 icon resources-1

Catalog of public resources (such as code, papers and datasets) produced at UofC CS/CDAC and research partners.

rumor icon rumor

Nonparametric timeseries classification for Twitter trending topic detection (MEng thesis)

t2cg icon t2cg

Code for the second homework assignment (T2) - Computer Graphics Discipline (year ~2000)

ticker icon ticker

Terminal stock ticker with live updates and position tracking

tsne-cuda icon tsne-cuda

GPU Accelerated t-SNE for CUDA with Python bindings

video_collection icon video_collection

Tools used to collected video session data (with ground truth) for a number of service

ws icon ws

Simple to use, blazing fast and thoroughly tested WebSocket client and server for Node.js

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.