Git Product home page Git Product logo

undp / digital-development-compass Goto Github PK

View Code? Open in Web Editor NEW
31.0 31.0 17.0 339.36 MB

Automated data scraper: points to unstructured public data sets to create a Digital Development Exchange for open data, mapped to the Digital Transformation Framework then uses GitHub Actions to process data into CSV files for the Digital Development Compass to calculate and visualize.

Home Page: https://www.digitaldevelopmentcompass.org

License: GNU Affero General Public License v3.0

Rich Text Format 0.02% JavaScript 0.31% Jupyter Notebook 96.06% TypeScript 3.26% CSS 0.01% Python 0.34%

digital-development-compass's People

Contributors

anacbaez avatar charlesnliu avatar flat-data avatar github-actions[bot] avatar hannapetra avatar isuruariyarathne avatar jamiegreee avatar jobcollins avatar mattrothenberg avatar mbelinsky avatar naledi-holly avatar okrstulovic avatar sapumalxep avatar shiyis avatar shurtadocano avatar trivo1995 avatar wattenberger avatar zapumalx avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

digital-development-compass's Issues

Jobs to be done

@idan, @mattrothenberg, Irene, & @Wattenberger (OCTO DX) got together to flesh out the tasks that are needed to make this project a success. We figured this would be the best way to split up the work. Please edit as much as you want!

Task Notes Captain Technologies
1. Build data manifest Fill out data_manifest.csv (below) Mark spreadsheet
2. Collecting data Fetches data and turns it into csvs OCTO DX Flat, Deno
3. Processing raw data Turning csv files into scores Mark ??
4. Designing the website Getting the Figma designs to a code-ready state    
5. Mapping out the information architecture A spreadsheet that lists out the pillars & sub-pillars Mark  
6. Building the website structure   OCTO DX Github pages + React?
7.\ Building the data visualizations ** blocked by #6 OCTO DX React
8. Figure out hosting on UNDP website      
9. Maintaining the website in the future   Mark  

Data manifest details:
Matt & Amelia dug into the filename matching spreadsheet, and there's a good amount of work that needs to be done to get all of the data into clean csv files. We put together a spreadsheet that lists the necessary info for fetching that data - check out the first two rows and please let us know if anything's unclear.
data_manifest.csv
What we found was that converting between formats (eg. xlsx -> csv) was straightforward, and most of the work here will revolve around figuring out where the data actually lives (eg. in the third spreadsheet in the xlsx download).
We were thinking we could use our current project that fetches data and processes it using Deno scripts. For example, this script to convert xlsx -> csv:

import { xlsx, readXLSX, writeCSV } from "https://deno.land/x/[email protected]/mod.ts";

const inputFilename = Deno.args[0];
const outputFilename = inputFilename.replace(".xlsx", ".csv");

const workbook = await readXLSX(inputFilename);
const sheetData = workbook.Sheets[workbook.SheetNames[0]];
const csvString = await xlsx.utils.sheet_to_csv(sheetData);

await writeCSV(outputFilename, csvString);

Set up barebones github pages site

From slack discussion, it sounds like we want this to be a React app. Let's stand up an initial app to get started.

  • Set up barebones app
  • Get app to fetch basic data from "database" (the project repository)

Lesotho missing on map

The country borders for Lesotho are not visible on the homepage and the country cannot be selected from the map. But visible in data.

Create designs for data visualizations

Drawing on the alpha and beta wireframes and the available datasets, do some exploration of what data visualizations we could create. This issue will track designs and async feedback.

Create web designs

Let's confirm how this page(s) will fit into https://data.undp.org/. In the case that this will be a standalone website, this issue will track creating web designs including layout, branding, etc.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.