Randomised sequence of data quality test results in CSV data output about biocache-service HOT 8 CLOSED

From @mbohun on August 19, 2014 12:22

date: Wed Dec 18 19:32:57 2013
author: [email protected]

How is the user donwloading the records?

There is a way to stop the DQ from being included in the downloads. We don't expose it as an option in the biocache/hubs/spatial portal webapps.

The biocache-service allows for the DQ to be turned off using a URL of the following format:
biocache.ala.org.au/ws/occurrences/index/download?q=data_resource_uid:dr364&qa=none&reasonTypeId=10

The &qa=none prevents the data quality from being included in the download.

from biocache-service.

From @pbrenton on August 19, 2014 12:22

date: Fri Dec 20 02:41:19 2013
author: [email protected]

Not sure Natasha. He does find the DQ results useful, so switching off is probably not the best option. He was just asking if we can make the sequence of columns consistent in outputs.

from biocache-service.

From @mbohun on August 19, 2014 12:22

date: Sun Dec 22 13:50:47 2013
author: [email protected]

The other option is for him to decide which data quality fields he wishes to include and specifying them in the order he wishes to see them:

Example:
http://biocache.ala.org.au/ws/occurrences/index/download?q=data_resource_uid:dr364&reasonTypeId=10&qa=decimalLatLongConverted,invalidCollectionDate,speciesOutsideExpertRange,stateCoordinateMismatch,invalidScientificName

This is not exposed in the biocache/hubs UI. At the moment it is only available as a webservice call. This field is documented in the download section of the biocache documnetation:
http://biocache.ala.org.au/ws

Maybe we need to expose this in the Download dialog to allow users to decide which QA fields it include.

from biocache-service.

From @mbohun on August 19, 2014 12:22

date: Sun Dec 22 16:00:16 2013
author: [email protected]

There are 2 components to this issue:

1. Ensure that when no &qa param is provided the DQ fields are in the same order each time the exact same download is performed.

2. In hubs-webapp expose a selection of download fields and QA's for the user to select in the Download dialog.

from biocache-service.

From @mbohun on August 19, 2014 12:22

date: Mon Dec 23 17:44:30 2013
author: [email protected]

Component 1) in comment #4 is on dev

from biocache-service.

There is an option qa=includeall that will not remove empty columns like qa=all does. But if assertions ever change in biocache-store the columns returned will change.

As 2) above suggests is best if qa columns are specified so they do not change over time.

from biocache-service.

List of valid qa fields as mentioned above. http://biocache.ala.org.au/ws/assertions/codes

from biocache-service.

Is any more required for this issue?

from biocache-service.