opsilab / idra Goto Github PK
View Code? Open in Web Editor NEWIdra - Open Data Federation Platform
Home Page: https://idra.eng.it
License: GNU Affero General Public License v3.0
Idra - Open Data Federation Platform
Home Page: https://idra.eng.it
License: GNU Affero General Public License v3.0
The list/number of federated catalogues shown in the "Federated Catalogue" page of the Idra portal, is different from the real one (number reported in the homepage).
1、As i know the NGSI v2/entities get rest api support the limit(up to 1000) and offset parameter,I setup the idra Catalogues below:
[{
"title": "SampleData",
"description": "",
"theme": [
"GOVE"
],
"keywords": [
"SampleData"
],
"distributions": [
{
"title": "SampleData",
"description": "",
"distributionAdditionalConfig": {
"query": "type=SampleData&options=keyValues,count",
"fiwareService": "",
"fiwareServicePath": ""
},
"mediaType": "",
"license": {
"uri": "",
"name": "license",
"type": "",
"versionInfo": ""
}
}
]
}
]
the count of SampleData is 20000+ or more but the v2/entities get rest can only return 1000 max records。how can i deal with this condition.
2、the Idra datalet table is then same scene,is there any way to dynamic paging the CB datas in the table?
Look forward to your reply
thanks!
It would be interesting having the possibility to choose among several remote catalogues.
On the Idra ReadtheDocs project, all no versioned documentation is displayed
I used the API /api/v1/client/search with a payload like the following:
{
"filters": [{
"field": "ALL",
"value": "key1 key2"
}],
"live": false,
"sort": {
"field": "title",
"mode": "asc"
},
"rows": "1000",
"start": "0",
"nodes": [92],
"euroVocFilter": {
"euroVoc": false,
"sourceLanguage": "",
"targetLanguages": []
}
}
Currently the search on key1 and key2 is always done in AND, reducing the number of results.
The API should give the possibility to search also with keys in OR.
Idm Login not working due to jar conflict with tika-parser
Several dependencies have been identified which do not have a LICENSE
and therefore need to be removed or updated to licensed components:
github.com/OPSILab/Idra angular-ui-ace
github.com/OPSILab/Idra angular-ui-layout
github.com/OPSILab/Idra COS
Elements without a LICENSE
are technically All rights reserved and should not be used in Open Source
It woud be useful having the chance to dynamically customize the look and feel of the Front-End
Also the Opendatasoft portals should be federable
Provide a connector that is able to provide in Idra datasets based on Orion queries
How i can insert the Link (url to the ngsi-context.jsonld file) as a header to the request for Orion-LD Catalogue ?
When i create a new catalogues -> ORION-> NGSI-LD -> Add/Update file, there is no option to add the Link as variable. I can only insert fiwareService and fiwareServicePath.
Without the Link (jsonld file) i cannot access the value of the IOT sensor.
With Link to the header
curl -G -X GET 'http://localhost:1026/ngsi-ld/v1/entities/'
-H 'fiware-service: openiot'
-H 'fiware-servicepath: /'
-H 'Link: http://context-provider:3000/data-models/ngsi-context.jsonld'
-d 'id=urn:ngsi-ld:Device:temperature001'
-d 'attrs=temperature'| jq .
[
{
"@context": "http://context-provider:3000/data-models/ngsi-context.jsonld",
"id": "urn:ngsi-ld:Device:temperature001",
"type": "TemperatureSensor",
"temperature": {
"value": 24,
"type": "Property",
"unitCode": "CEL",
"observedAt": "2021-07-19T11:31:26.331Z"
}
}
]
Without Link to the header
curl -G -X GET 'http://localhost:1026/ngsi-ld/v1/entities/'
-H 'fiware-service: openiot'
-H 'fiware-servicepath: /'
-d 'id=urn:ngsi-ld:Device:temperature001'
-d 'attrs=temperature'| jq .->
Empty: []
For every CKAN node federated on IDRA, the system should check if the datastore APIs are available and then add the datastore endpoint among the distributions of each dataset.
Docker logs says:
Failed to execute goal on project Idra_Maven: Could not resolve dependencies for project rspa:Idra_Maven:war:0.0.1-SNAPSHOT: Could not find artifact com.github.jsonld-java.jsonld-java:jsonld-java:bundle:0.9.0 in jitpack.io (https://jitpack.io)
The problem is related to jitpack, investigating...
It would be interesting having an automatic evaluation of the datasets federated. Such evaluation could be done accordingly to several parameters like, for example, the update frequency and/or the metadata completeness
The following MUST requirements for full GE status are not currently satisfied:
Missing Badges:
Missing items within the README
Missing Docker Items
No CREDITS file
An incubated enabler should be working to fulfilling these requirements
SHOULD requirement from the TSC
At the moment Idra has no information in the Academy and does not minimum Training section requirements for a Full GE. This is a placeholder to ensure a simple Perseo hello world gets added to the Step-by-Step tutorials at some point
An incubated GE should be working to fulfilling these requirements
Enable Idra administrator authentication via Keyrock (v7.0) identity manager.
The "Edit on Github" links of the readthedocs here, leads to a 404 page.
In this moment every dataset has this URL https://opendatafederation.eng.it/#/showDatasetDetail#scrollHere
Thank you
Thanks a lot for the project
Can you please check the following link, they seems to be down
https://idra.eng.it/
https://opsi-lab.it/catalogues.json
https://idra-sandbox.eng.it/
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.