Light

azavea / pfb Goto Github PK

View Code? Open in Web Editor NEW

This project forked from spencerrecneps/pfb

2.0 20.0 2.0 120 KB

License: Other

Python 12.46% Shell 52.47% PLSQL 26.11% SQLPL 8.96%

pfb's Introduction

DEPRECATED

This was pulled into azavea/pfb-network-connectivity at 8561f90ba.

Further work should be done over there.

pfb

Docker

To run the analysis in docker, first build the docker image:

docker build -t pfb .

Then run the analysis as follows:

docker run \
    -e PFB_SHPFILE=/data/neighborhood_boundary.shp \
    -e PFB_STATE=ma \
    -e PFB_STATE_FIPS=25 \
    -e NB_INPUT_SRID=2249 \
    -e NB_BOUNDARY_BUFFER=11000 \
    -v /vagrant/data/:/data/ \
    pfb

The -e in this example sets environment variables, which will depend on the analysis you are running.

The -v in this example mounts a local directory inside the docker container under /data/. The PFB_SHPFILE environment variable specifies the .shp file under this directory to use.

This process of mounting a data directory with the input shapefile will be removed in favor of an import process.

pfb's People

Contributors

Stargazers

Watchers

Forkers

flibbertigibbet klaash

pfb's Issues

Parameterize run_connectivity.sh to run with arbitrary amount of threads

Large analysis jobs trigger postgresql checkpoints too frequently

Checkpoint triggered about every ~5 seconds during graph building in TDG functions when postgresql is using its default configuration

Add export_connectivity.sh script to Docker analysis

Should be configured to save export data somewhere

Parameterize streetlights files once added to the analysis

Streetlights sql code needs to be parameterized for:

NB_BOUNDARY_BUFFER
NB_OUTPUT_SRID

Export neighborhood_ways as geojson in export_connectivity.sh

Easiest way to do this is with ogr2ogr, but installing via the gdal-bin package provided by the ubuntugis PPA leads to a dependency conflict with the postgresql-9.6-postgis-2.3 package, where gdal-bin expects libgdal2 and postgresql-9.6-postgis-2.3 expects libgdal1h.

This would resolve nicely if the analysis and postgresql service were two different containers. Otherwise it might be best to install the gdal tools from source?

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.