Git Product home page Git Product logo

dataengbb's Introduction

Portfolio Images

Hi, I'm a Senior Software Engineer working for DSI Data Science Institute. I'm currently allocated to the Internet Equity Initiative (IEI) as a Backend/Data Engineer. I have +20 years of working on Computer Networks with experience in Security, HPC, and Mobile. Recently, I've been shifting the gears for everything's Data and Education, BI, and Decision-making processes. My latest project is running at https://beadchallenge.org with a serverless backend.

Instead of a wordy Resume, here's a more relaxed collage of images with important documentation of my work as most of it is open source. Also, check out my latest work on UI dashboarding IEI Netrics data on https://tigerteam.io.


image
Figure 1. This is the Netrics backend stack I'm responsible for. Some of this is WIP but most have been in prod for 3 years and crossed the 1 billion data-point mark of encrypted data. The stack includes small Golang data collection applications, python IaC (Serverless AWS code), terraform code, SQL database schema, parallel Python data ingestion, Kafka producer/consumers.


image

Figure 2. Aggregated average latency (active unloaded ICMP) for all Netrics deployed devices in Chicago city. As expected: fiber tech has lower latency. Data warehoused on TimescaleDB, image extracted from Superset BI tool. Estimated devices deployed: 120 in Chicago area. We benchmark the internet for ISPs to ensure internet consumers are getting a fair performance from their contracted services.


image

Figure 3. A Netrics Grafana dashboard with fluctuation on both latency and speed test. High-performance multiplayer games must have Netrics installed and keep an eye on their performance over time.


image

Figure 4. Campus deployment of Netrics, showing high latency for an outlier (Booth School). Image extracted from Looker Studio.


Figure 5. BEADChallenge.org analytics, where the internet speeds are lower (underserved) in IL, USA?


portifolio_analytics1

Figure 6. Data analysis work for the Internet Equity Initiative group. Does the low-income population have worse internet performance than the high-income? What does it mean to be an underserved or unserved area regarding broadband infrastructure? Is the broadband evolving in the US (2019 - 2021 comparison)?



Video 1. Netrics Passive in action (aka NetMicroscope). Software implemented in C with libwebsockets, libpcap, html, javascript, jquery, chartjs.
[WSJ Study](https://www.wsj.com/graphics/faster-internet-not-worth-it/)

image


image

Figure 7. Netrics Passive Schematics developed circa 2015. A $200 kit (Jetson Nano 472 GFLOPS) for high-performance passive packet capture, network monitoring and ML inference.


image

Figure 8. My earlier work (circa 2009-2011) on Deep Packet Inspection (DPI) for Alcatel-Lucent, programming CloudShield/IBM equipment (PacketC / C ). I was the principal engineer for the protocol/app service detection intelligence of the network traffic control engine called Agya. The solution was deployed in the Latin America region, mainly in Brazil.

A few of my certificates:

image image image image image image

dataengbb's People

Contributors

dependabot[bot] avatar ggmartins avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

Forkers

madanuuk2

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.