If you try to hit endpoints with no ODK submissions, the server crashes, because it's missing directories. Don't crash in this situation, it's ok.

sometimes you want very basic auth to protect the site if you put it up publically anywhere.

Add support for simple username/pass for one user for the entire site. No need to do user management and all that jazz.

This should be configurable to be default off and then turned on via posm-build install

We want to use Material Design Lite.

There are many ways to bring it in as a package like npm and bower, but let's just directly include it in the Jekyll project so we don't have yet another dependency.

We do want to tweak the CSS to have the OpenMapKit Look and feel. Take a look at OpenMapKit iD editor. We want to match those colors for the top bar and other elements.

OpenMapKit Icon

OSM Green: #7ebc6f
OSM Light Green: #ff8bd27c
OSM Dark Green: #83b26e

pyxform only understands xlsx format. It does not understand xls format. Make sure that it checks for this and provides an informative error.

Currently the /omk/deployments endpoint is down on Dale's server. We're getting

{
status: 500,
msg: "Unexpected token ]",
err: { }
}

This is because the JSON in one of the manifests is formatted improperly. Handle this gracefully so the rest of the deployments continue to show up.

cc/ @dalekunce

In the upper right there is a link to submissions that isn't associated with a form.

We don't need that link, since there is a link to the submissions for a given form in the Forms page

This module should directly talk to get-osm-submissions.js to get OSM data. This module is responsible for opening and submitting changesets to an OSM server.

It shouldn't just be a REST controller, because we are going to need to directly call it by the OSM Submission module.

This is the master issue of the server component regarding the provisioning of data for a field deployment.

Below is the drawing from the kickoff meeting describing how a deployment is abstracted.

OpenMapKit Server will provide all of the proper metadata needed by OpenMapKit Android to find and retrieve data associated with a deployment. The actual data will be served as static assets, and metadata for a specific deployment will reside in a manifest.json file within the directory of the deployment.

The actual OSM data in the deployment such as OSM XML and MBTiles will be generated by posm.

Work on this feature will be in the deployment branch.

Need a simple GUI to upload forms to the server. Ideally this would be a drag and drop interface.

This lib isn't async. We want this xml comfoolery to be on a worker thread. If the server is doing a lot of XML parsing, is it going to jam up?

Create a limit query parameter limits how many OSM XML files make it to the response. Using this a long side with the blacklist checksum patching mechanism, we can paginate through all of the OSM in chunks we feel comfortable with.

We should have a simple install and setup readme.

Works on Mac Chrome, does not on Android Chrome. Why? My guess is css issue.

for times when data is collected over multiple days but we want to do a rolling upload to OSM. it would be nice to have a way to export (or just get easily, through filtering in JOSM somehow) a subset of the osm file export

for example data collected on Tuesday is downloaded, conflicts resolved and it’s uploaded on Wednesday, more data collection on Thursday, want to get an osm file with only the new data submissions. can use the 'purge' advanced JOSM tool to have it forget selected data but you still have to be able to know which features are new and somehow select everything else.

Hi all,

I success build OMK Server in my local server and right now I'm curious about how to download all the result from field mapping because all the finished form that i uploaded to server have unique folder name with .json and .xml file inside the folder.

Is OMK server also have capabilities to append/combine all the submitted form as one csv file? If yes, would you guys tell me how to do it? Thanks

I think using const keyword is the only thing stopping us from running on NodeJS 0.10.*. Might be good to just go old school and use var only.

Tweak @rrlara bash script to build Jekyll so that it properly builds into the /pages directory.

Right now, when you submit a file, it does a form submission that brings the user to a new place -- raw JSON.

Instead, we want an AJAX POST and then display the msg field in a snackbar.

Our best-practice is to pin it to either a specific patch or minor version using a .nvmrc in the project's root directory. See nvm more more info.

A sample .nvmrc that pins Node to 4.2.x (assuming users use nvm and run nvm use / nvm install) looks like:

4.2

I get this message when I want to visit the website :

404
There isn't a GitHub Pages site here.
If you're trying to publish one, read the full documentation to learn how to set up GitHub Pages for your repository, organization, or user account.

GitHub Status — @githubstatus

Until we determine what we want to put there, let's delete it so that Express can continue giving a directory listing.

I'll go in and have http://posm.local/omk do an automatic redirect to http://posm.local/omk/pages/forms for now, since that's a good entry point to see what is there.

is it possible to include any more details when a form fails to upload?

omkserver appears to have just one generic message:

(also, which appears to be missing a space before the file name)

formhub is much more helpful:

ODK Collect only shows one form if the server has multiple forms with the same ID. Upon upload, check this, and inform the user if there is a problem (or automatically add a number at the end).

Hi,

I want to try OMK server in my virtual machine (Ubuntu Server 15). And when i want to run npm install i got these error:

Do you guys know what's the problem? Did i missing something that i need installed before i run npm install?

My position is fresh install Ubuntu Server 15.04 and just installed npm for run npm install

currently there is no way to delete a survey using the GUI.

Be sure to include a confirmation dialog.

Something is wrong with this file, and I'm not so sure that it's because it is somewhat larger than usual (2.6M).

http://omkserver.com/submissions/colombia_buildings_edited.osm

https://www.dropbox.com/s/ul0h5woajlrnggx/colombia_buildings_edited.osm?dl=0

Debug this and figure out why it is causing iD to hang. It could be:

1. iD really can't handle files that big (doubt that's the problem)
2. Something wrong with the XML
3. ?

Clicking on the Icon or OpenMapKit Server should bring you back to the main page.

We need a page showing the forms available. This endpoint shows a list of forms:

/formList?json=true

An example of this endpoint's response:

{
  "xforms":{
    "attributes":{
      "xmlns":"http://openrosa.org/xforms/xformsList"
    },
    "xform":[
      {
        "name":"Building Placeholders",
        "formID":"building_placeholders",
        "hash":"md5:0e13893e49a5e567f864de01de6ab2c0",
        "downloadUrl":"http://localhost:3210/omk/data/forms/building_placeholders.xml"
      },
      {
        "name":"Buildings",
        "formID":"buildings",
        "hash":"md5:007b8707e0bb9c2c6ef53502df915ae7",
        "downloadUrl":"http://localhost:3210/omk/data/forms/buildings.xml"
      },
      {
        "name":"Buildings with POIs",
        "formID":"buildings_with_pois",
        "hash":"md5:b4d9f02b7fd41c52004c0889fa8b4d37",
        "downloadUrl":"http://localhost:3210/omk/data/forms/buildings_with_pois.xml"
      },
      {
        "name":"Mobile Money Agent",
        "formID":"mobile_money",
        "hash":"md5:1431de362053a476a9778bbae349b614",
        "downloadUrl":"http://localhost:3210/omk/data/forms/mobile_money.xml"
      },
      {
        "name":"Points of Interest",
        "formID":"pois",
        "hash":"md5:cfa8c4a0e95aa98047f33d9c5d946831",
        "downloadUrl":"http://localhost:3210/omk/data/forms/pois.xml"
      }
    ]
  }
}

We want to see this info in a Material Design card layout of similar size to the PSOM home page:

A given form should show up in a card about that size. We probably want the little bottom tab part actually be on top and be the name. In each card we should see:

1. Name
2. Number of Submissions
3. Form ID
4. XLS / XML download URLs

We want to link the name field to the /omk/pages/submissions page so that the user can see the submissions for the given form and download a CSV.

Lastly, we want to have a link to iD and Upload Form in the top header.

In Huaquillas, we found that we really want to automatically submit all OSM edits to POSM OSM API. QA can be done by the main iD and JOSM from there. iD behaves normally with a standard OSM API, however the OMK OSM API gives iD too much data for the SVG rendering to work.

We need to resolve:

1. Automatically uploading OSM XML submissions to POSM OSM API.
2. Provide an alternative means of viewing OSM data submitted for a form. We wanted to be able to filter by date, OSM User, and Field Paper. This will no longer be possible once the data is in the POSM OSM API.

Discussion needed.

Setup a Jekyll project in /jekyll. Have the project build the following pages:

1. submissions
2. upload-form
3. forms

Let's start with just those three. There will be more. We haven't started forms yet. I'll make an issue for that.

a select_multiple with answers like
1 Meat
2 Poultry
3 Fish
4 Fruit
5 Vegetables
97 Other
98 Refused
99 Don't Know

mostly has data like

"marktype": "3 4 5",

but will also appear like

"marktype": {
      "latitude": 1,
      "longitude": 3,
      "altitude": 4,
      "precision": 5
    },

(links to example occurrences are on April 4 in the posm channel in the openmapkit slack)

Somehow we've got 104 changed files in the jekyll branch:

It's probably easier to start a new branch and paste in what we really need.

Things got refactored in the API that we don't want to touch:

This should be easy, since we are only touching the jekyll and pages folder in this sprint.

Also, we need to .gitignore sass cache.

download xls goes here:
http://omkserver.com/omk/data/forms/colombia_buildings.xlsx
which returns:

Cannot GET /omk/data/forms/colombia_buildings.xlsx

The number of submissions in the Forms page is not correct. in the /formsList?json=true endpoint, we should say how many submissions there are so we can have a real number in the UI.

Since the refactor that happened about a month ago, many of the unit tests are broken due to new paths of things. In particular, the deployment unit tests don't work.

Lots has changed and improved. The docs are out of date.

I've updated some info about the endpoints, but I need to iterate further.

e0f5076

Put download links for all relevent files in the sandwich button on each card for each survey.

Links include

• XLS form
• Xform
• OSM
• CSV
• JSON

when uploading a form, if the filename already exists, it overwrites the form. i think it should throw an error instead.

There is a submission in the Cruz Roja Huaquillas data set that sets the OSM file in the data.json to null.osm. This is not right. In the data, there is an actual OSM file. Determine what bug has caused this to happen.

http://posm.local/omk/data/submissions/ecuador_buildings/0c2fd24d-d08b-48b5-9bac-790cb03c2f73/data.json

Special characters are garbled in the json data on the server.

Mapper_registration_v1-0-2/44d28929-b177-4169-89db-1f1dc639895d/data.json

"FIRST_NAME": "Saa Célestin",

Mapper_registration_v1-0-2/912774e0-005f-4ae7-9404-6b8338d1498d/data.json

"QUARTIER_OU_DISTRICT": "Kènèma",

Mapper_registration_v1-0-2/1fae7871-0608-4c5d-9748-b3c33066b8bd/data.json

  "REGION_NAT": "Basse guinée",

We have to expose the fp.geojson file in the deployment in the API. This is the contents of map.geojson that Field Papers provides. This GeoJSON is essential to move forward on

posm/OpenMapKitAndroid#19

This GeoJSON file can be used by OpenMapKit Android to draw the bounds of each field paper page. We also will use this to zoom the map to the extent of the field paper.

We need a decent collection of sample XLS and XForms to be provided in the server by default. These should be good starters for people to make their own forms.

We want a simple app where we can apply submit time and username based filters, get that filtered and aggregated OSM XML file.

We need to:

1. Download for JOSM
2. Open in iD
3. Try to directly submit to OSM

In further brainstorming at RedCross HQ in DC, we have decided that we want to have the OMK OSM API filter by field papers page. This way, the user will be able to validate submissions field paper page-by-page -- makes sense with the intended workflow. Also, it will reduce overwhelming ID with too many SVGs to render.

This is an easier solution to implement, because we will not need to rethink the architecture of the current API, and it will be a tighter integration with Field Papers.

Implementing this decision will resolve #28 and alleviate the need for #13

cc/ @DrishT @dalekunce @mojodna @danbjoseph @rbanick

The Download button should have a given link be:

http://posm.local/omk/odk/submissions/ecuador_buildings.osm

instead of

http://posm.local/submissions/ecuador_buildings.osm

Create a script, REST endpoint, and simple UI that tar.gz up the data directory of OpenMapKit to a backups directory. Serve that directory as a downloadable end point.

There is a bug with either the closure or a const. When hitting an endpoint like this:

http://localhost:3210/odk/submissions/gampaha_2.json

We're getting an array of identical submissions, rather than unique submissions.

[
{
formhub: {
uuid: "0869fb2f13224809918f0120a1d46b93"
},
today: "2015-12-26",
deviceid: 864506020150190,
surveyor: "Malinga",
feature_type: "building",
osm_building: {
originalFilename: "OSMNode-1.osm"
},
form_completed: "2015-12-26T12:43:42.529-08",
meta: {
instanceId: "uuid:37c76b15-7e22-4244-b02d-a94892dab8f7",
instanceName: "Gampaha_draft_survey_v2",
formId: "gampaha_2",
version: 201511261115,
deviceId: "imei:864506020150190",
submissionTime: "2015-12-26T20:44:15.455Z"
}
},
{
formhub: {
uuid: "0869fb2f13224809918f0120a1d46b93"
},
today: "2015-12-26",
deviceid: 864506020150190,
surveyor: "Malinga",
feature_type: "building",
osm_building: {
originalFilename: "OSMNode-1.osm"
},
form_completed: "2015-12-26T12:43:42.529-08",
meta: {
instanceId: "uuid:37c76b15-7e22-4244-b02d-a94892dab8f7",
instanceName: "Gampaha_draft_survey_v2",
formId: "gampaha_2",
version: 201511261115,
deviceId: "imei:864506020150190",
submissionTime: "2015-12-26T20:44:15.455Z"
}
},

Fix this and have a unit test to prove it.

if images have been collected as part of the ODK portion of a survey. is there a way to get a single download of all the image files?