Git Product home page Git Product logo

dev-communities's Introduction

Dev Communities

This repository contains the work I did to map out and create data visualizations of the communities around creators of tech content in Portuguese. So far there are two viusualizations that resulted from this work, one for Twitter communities and another one for Twitch live-coding communities.

The complete zoomable SVG of these visualizations are available in the following links: Twitch, Twitter.

Twitch Portuguese Speaking Live-coders

Twitch communities visualization

Twitter Portuguese Speaking tech content creators

Twitter communities visualization

What's in the repository

The repository contains the raw data that was collected as well as the scripts that were used to collect and process it. Feel free to use the data and scripts as you please.

Collecting Data

The methods for collecting data for each visualization differ a lot from each other. The scripts used are under the data-mining folder of each respective visualization.

Visualizing

The above visualizations were created using a Graph visualization tool called Gephi. Gephi needs a specific file format for both nodes and edges, the script on shared/PrepareForGephi.py processes a CSV containing accounts in the headers and their respective followers/watchers/etc in the cells. The script outputs two different files that can be imported by Gephi as nodes and edges.

The positioning of the nodes above is defined using a Force Atlas algorithm and the colors of the nodes are defined using the Modularity analyis of Gephi. The parameters for these differ on each visualization and are the result of playing with the tool until a nice and meaningful visualization appears.

Credits

Both the idea and part of the code on this repository were inspired by a work done by Kiran Gershenfeld. He was the first one to apply this visualization to Twitch communities and these visualizations are merely a replication of his concept using a more specific niche (Portuguese speaking developers). He wrote a very nice article about his work on Towards Data Science. I strongly recommend reading it. The repository for his work is the following: https://github.com/KiranGershenfeld/VisualizingTwitchCommunities.

dev-communities's People

Contributors

grsoares21 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

Forkers

mlj-81

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.