When following the instructions for wiki installing OGDI DataLab Version 5 on Azure and using NuGet to get the dependencies for DataLaoderGuiApp, the package downgrades the version of the Fluent.dll. It changes the project references away of the Shared folder.

Actually, the NuGet package "OGDI DataLab DataLoaderGuiApp Dependencies" is not required anymore in the current release.

The wiki should not include "OGDI DataLab DataLoaderGuiApp Dependencies" as an item in point 6 under "To install the OGDI DataLab dependencies" heading.

I want to change one dataset's field types. For the time being my fields are strings and I want to change it to integers.
I tryied from data loader loading the dataset changing the fields' types, saving and seting upload mode to update.

I get the following results:
Metadata for GoatsByRegionBrokenDownByMainCategories was changed.
totalholdings : existing = System.Int32 : new = System.Double
totalgoats : existing = System.Int32 : new = System.Double
goatswhichhavealreadykidded : existing = System.Int32 : new = System.Double
goatsmated : existing = System.Int32 : new = System.Double
othergoatsnotmated : existing = System.Int32 : new = System.Double
otherfemale : existing = System.Int32 : new = System.Double
billygoats : existing = System.Int32 : new = System.Double
othermales : existing = System.Int32 : new = System.Double

What I have to do to update an existing dataset. I just need to change field types. Nothing more.

Thanks in advance.

Currently you must modify code in order to remove the ability to disable analytic capturing in DataLab.

If we are not allowed to track personal information as a legal standpoint, it would be nice to be able to disable this by configuration.

Seems that a configuration check could be made in Ogdi.Azure.AnalyticsRepository before writing the information to Storage.

Data Loader: Before throwing an error "XYZ is not a valid Table Name" after you click "Start", validate that the table name is named correctly:

Table names may contain only alphanumeric characters.
Table names cannot begin with a numeric character.
Table names are case-insensitive.
Table names must be from 3 to 63 characters long.

These rules are also described by the regular expression "^[A-Za-z][A-Za-z0-9]{2,62}$". Table names preserve the case with which they were created, but are case-insensitive when used.

I am pretty excited about OGDI. Would it be possible to do a local installation and later deploy to Azure?

If I can do a proof-of-concept, I could use the prototype to gather internal support.

Setting RecaptchaPrivateKey & RecaptchaPublicKey values doesn't "take" and causes errors.
Keys set in:

\DataBrowser\DataBrowser.WebRole\Web.Release.config
\DataBrowser\DataBrowser.WebRole\Web.config
\DataBrowser\DataBrowser.Cloud\ServiceConfiguration.Cloud.cscfg
\DataBrowser\DataBrowser.Cloud\ServiceConfiguration.Local.cscfg

End-result the error below:

Source File: e:\sitesroot\0\Views\Shared\Rates.ascx Line: 72

Line 70:
Line 71: function ShowRecaptcha() {
Line 72: Recaptcha.create('<%= Ogdi.Azure.Configuration.OgdiConfiguration.GetValue("RecaptchaPupblicKey")%>', "RecaptchaDiv", { callback: Recaptcha.focus_response_field });
Line 73: document.getElementById('RecaptchaButtons').style.display = "block";
Line 74: }

This issue is caused by the how Data Container (Windows Azure Storage) urls are created by using a replacement token (http://{0}.table.core.windows.net).

When the Data Container is setup in the ConfigTool, a storagename and storagekey is provided. This is used to provide the application a Storage Location to retrieve the data loaded using the DataLoader.

This is a problem when providing the local storage values as http://devstoreaccount1.table.core.windows.net is not a valid storage account most likely doesn't have the accountkey of Eby8vdM02xNOcqFlqUwJPLlmEtlCDXJ1OUzFT50uSRZ6IFsuFq2UVErCz4I6tq/K1SZFPTOtr/KBHBeksoGMGw==

Here is how storage urls differ between production and the storage emulator:

Windows Azure Storage Url

• Blob: http://<accountname>.blob.core.windows.net/<resource-path>
• Table: http://<accountname>.table.core.windows.net/<resource-path>
• Queue: http://<accountname>.queue.core.windows.net/<resource-path>

Windows Azure Storage Emulator Url

• Blob: http://127.0.0.1:10000/&lt;accountname&gt;/&lt;resource-path>
• Table: http://127.0.0.1:10001/&lt;accountname&gt;/&lt;resource-path>
• Queue: http://127.0.0.1:10002/&lt;accountname&gt;/&lt;resource-path>

More details found on msdn article, overview of running a windows azure application with local storage

Hi,
I installed ogdi for test purpose. For now, I put the information that is available from datahub. But each csv file has an error...
"Failed to process entity.

Entity Start:
Name = 'EntityId' Value = '80ee7cda-9871-4ce6-88d2-68bf9f98e645'
Name = 'DATE' Value = '1970-01-01'
Name = 'VALUE' Value = '55.8'
Name = 'RdfSnippet' Value = '<rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:ogdi="ogdiUrl">rdf:Description<ogdi:date rdf:datatype="xs:string">1970-01-01/ogdi:date<ogdi:value rdf:datatype="xs:double">55.8/ogdi:value/rdf:Description/rdf:RDF'
Entity End

Value cannot be null.
Parameter name: field

Failed to process entity."

Ok, some of these files, regardless to the errors,was successfully uploaded.
Can someone explain what's going on? Of course, I used DataLoaderGuiApp...

I'm working on getting the project updated to VS2012 from a fresh installation. one item that doesn't come pre-installed is the ReportViewer Components which are available here: http://www.microsoft.com/en-us/download/details.aspx?id=6442

serviceUri keys should be pre-set to port 8080 for the
http://[DataServiceDNS].cloudapp.net:8080/v1/

The problem is that the full web auto installer from Microsoft forces upgrading to the newer version of the SDK and that breaks the project.

According an instruction document I received from an Andrew Stewart:

"One issue I encountered was with Microsoft.WindowsAzure.StorageClient library reference within DataLoaderGUIApp. I had previously installed Azure SDK for Visual Studio 2012 which had newer libraries. I was required to uninstall these tools and reinstall the SDK for Visual Studio 2010 (November release). I had to rebuild the project and it was fixed, may also have to re-add references manually."

I can confirm that this problem does exist in the project. The DataLoaderGUIApp will not run the XmlSerializer properly when creating a config file with the new SDK. That was as far as I could get tracing the problem.

https://github.com/openlab/DataLab/blob/datalab/DataLoader/DataLoader/Helpers/SerializationHelper.cs

line 30 : var serializer = new XmlSerializer(data.GetType()); //This is where it fails in the code.

In version 2.0 the ConfigTool prepared your Storage accounts to run the application against your own datasets, in this version there are several errors related to this configuration. Firs it only runs properly against Storage account and original service (ServiceURI) and if you use your own service browser URI you will get always the same error (due an exception because it can'not find the model (table sotorage with the curren configuration).

Documentation in the wiki area is confusing, mixing concepts and names that doesn't exist in the current version (4 or 5). InteractiveSDK is the name of the namespace but not the projects, and the page of the Service Topology is confusing either due there is like a Hosted Service for the Data Service but in the real solution this is included into the Web Role (DataBrowser)

Is there any way to create and configure Table Storage using our accounts and load only our datasets or is only available for using the current datatasets and configurations from http://data.govdata.eu

The page '/Reports/Reports.aspx' is missing a scriptmanager element from ASP.NET.

Tested with FF 7.0.1

FireBug returns error: p_elSource.attachEvent is not a function

Page gets "stuck" on loading.

Looks similar to errors caused by FF in BING maps:

• http://blog.turlov.com/2011/05/fix-for-bing-maps-not-working-in.html
• http://www.codeproject.com/Articles/190205/Fix-for-Bing-Maps-not-working-in-Firefox-4
• http://stackoverflow.com/questions/5566393/issue-with-bing-map-p-elsource-attachevent-is-not-a-function
• http://code.davidjanes.com/blog/2008/11/08/how-to-dynamically-load-map-apis/

Example:
http://datadotgc2.cloudapp.net/DataBrowser/Hack%20OpenData/MiltonSplashV1
http://openregina1.cloudapp.net/DataBrowser/openregina/BicyclePaths#param=NOFILTER--DataView--Results

Hi

I'm new in github so if I wrote in the wrong place I apologize

I'm trying to use dataservices but I found the cloud project outsite the solution in (DataService\Services)
are you working on it?

Why innerside the servicedefinitions.csdef there are errors like:
"<<<<<<< HEAD:DataService/Services/ServiceConfiguration.Cloud.cscfg".. or "======="... ??????

With the correct cloud project, and working dataservices, will I be able to upload and after download/use a KML file like http://datigis.comune.fi.it/kml/areeverdi.kmz??

many thanks everyone

Antonio

Hi,
Is there deploy guideline for version v6? I have not found guideline doc.

Best regards,
Milos

Is there option for deleting data from portal?

Fix the 1000 row limit issue in DataService & KML that cause the KML to be end at the 1000 row mark.

In the current version of the DataBrowser (KML map overlay) this should probably be done carefully, not to impact the way the map shows a limit number of points.

However, the KML download link AND the DataService should be retuning all the results.

Example: http://datadotgc2.cloudapp.net/DataBrowser/Hack%20OpenData/rows2323withGISv1#param=NOFILTER--DataView--Results

After changing the top nav, the side tabs in the /DataBrowser are now all been set to "Developer" and seem to be inactive

Analytics information - config storage account. The main databrowser page lists total views. When choosing a dataset and going to Data Browser page, views_today/views_total are incremented by 2 each time the page is reloaded.

I have a great problem in the last step of running the ogdi.
I have tested both v2 and v4 and I face exactly the same problem with the data loader utility.
I created all storages and services all went well and when i try to upload a simple csv file (in v4 its not , seperated but ; seperated) it seems to be imposible.
I try to upload a simple CSV file with contents like below:

a,b,c,d,e
1,51,35,14,2
2,49,30,14,2
3,47,32,13,2
4,46,31,15,2
5,50,36,14,2
6,54,39,17,4

The cfg that is created is below:

When the cfg is created and i push the start button i get the result below:

Entity Start:
Name = 'EntityId' Value = '2825dda9-909a-4e80-bf89-c951727a2b92'
Name = 'primar' Value = '1'
Name = 'a' Value = '51'
Name = 'b' Value = '35'
Name = 'c' Value = '14'
Name = 'd' Value = '2'
Entity End

Value cannot be null.
Parameter name: field

Failed to process entity.

Entity Start:
Name = 'EntityId' Value = 'fb64a28d-f716-4644-9fc9-2398f2c22939'
Name = 'primar' Value = '2'
Name = 'a' Value = '49'
Name = 'b' Value = '30'
Name = 'c' Value = '14'
Name = 'd' Value = '2'
Entity End

Value cannot be null.
Parameter name: field

Failed to process entity.

Entity Start:
Name = 'EntityId' Value = '75cdffbf-7add-4e7d-a283-1e37fa093fc2'
Name = 'primar' Value = '3'
Name = 'a' Value = '47'
Name = 'b' Value = '32'
Name = 'c' Value = '13'
Name = 'd' Value = '2'
Entity End

Value cannot be null.
Parameter name: field

Failed to process entity.

Entity Start:
Name = 'EntityId' Value = 'ca164c9c-9059-4654-b30f-71f6a3b2934a'
Name = 'primar' Value = '4'
Name = 'a' Value = '46'
Name = 'b' Value = '31'
Name = 'c' Value = '15'
Name = 'd' Value = '2'
Entity End

Value cannot be null.
Parameter name: field

Failed to process entity.

Entity Start:
Name = 'EntityId' Value = '2b86197d-731e-4a84-99a6-5f177382aff7'
Name = 'primar' Value = '5'
Name = 'a' Value = '50'
Name = 'b' Value = '36'
Name = 'c' Value = '14'
Name = 'd' Value = '2'
Entity End

Thanks

Data loaded with a fieldname that contains a leading underscore, i.e. "_coordinates" shows properly in the DataService: <d:_coordinates>... and the DataBrowser, but is omitted in the CSV that's generated for the download.

DataBrowser sporadically hangs with the dataset not showing, only the '/mages/loading2.gif"

Example: http://waodpreview1.cloudapp.net/DataBrowser/waodpreview1/BicycleLanesWaterlooV1#param=NOFILTER--DataView--Results

Most of the time latent elements BEFORE the dataset shows seem to be (from a few tests):
/DataBrowser/DataBrowserRun/ - Avg Latency 1.8 minute !
/HistoryIframeHelper/Index - Avg Latency 1.8 minute !

Most of the time AFTER the dataset shows it's the: addthis_widget.js that gets "stuck"

DataService: Fix case sensitivity in field name

ERROR:
http://datadotgcds2.cloudapp.net/v1/nipoc1/OGSCemeteryIndexNIPOC1/?$filter=TOWNSHIP%20eq%20'Grimsby'
http://datadotgcds2.cloudapp.net/v1/nipoc1/OGSCemeteryIndexNIPOC1/?$filter=township%20eq%20'grimsby'

WORKING: (both "township" and "Grimsby" must be case sensitive:
http://datadotgcds2.cloudapp.net/v1/nipoc1/OGSCemeteryIndexNIPOC1/?$filter=township%20eq%20'Grimsby'

DataBrowser: Ensure Text Query builder returns results regardless of case sensitivity:

http://datadotgcds2.cloudapp.net/v1/nipoc1/OGSCemeteryIndexNIPOC1/?$filter=TOWNSHIP%20eq%20'Grimsby'

should work, just as:

http://datadotgc2.cloudapp.net/DataBrowser/nipoc1/OGSCemeteryIndexNIPOC1#param=township%2520eq%2520%2527Grimsby%2527--DataView--Results

Seems the KML download feature in the DataService is not generating the KML correctly when there are special characters in the KMLSnippet of the KML code. Before writing should remove/replace instances where the nodes in the polygon have special characters.

Example: Erb & Peppler St

https://developers.google.com/kml/documentation/kmlreference

It would be quite nice if we could get a ckan style API (http://docs.ckan.org/en/latest/api.html ) for accessing the catalog. Currently I can't find a way to access the metadata of datasets that's shown in the Data Browser portal. Or do I miss something?

Kind regards
Juergen

I was working with my copy of the project and noted a typo in the TopList date format.

The DateFormat resource has a value of "mm/dd/yyyy". In C# date format that means: minutes/days/years. The correct DateFormat to be used (which IS used on the LastUpdateDateFormat is "MM/dd/yyyy". This issue is in Resources->Views->DataCatalog->TopList.resx.

I'm not sure if this is a decision to add to the project or not, but adding fuller support for KMZ files. I was able to modify the uploader with another project that is open source so the DataLoader can open a kml file within a KMZ file. The project that I used is SharpKML off of codeplex and it uses a Zip file framework. So far the implementation was fairly simple by adding references to the new format type, and adding a new KMZ implementation closely based upon the KML implementation for upload in the DataLoader project. I'm now working on seeing if I can get the downloader to also allow to download a KML or KMZ file afterwards from the website.

Found an broken webpage dealing with Web Request page. New.cshtml has some invalid html in it and when I run the project it fails on poorly formatted html. When I fixed the html it then threw the error that there is a compilation error. Now I am using an older build of the project but I did a compare on the cshtml and the formatting issue is there.

https://github.com/openlab/DataLab/blob/datalab/DataBrowser/DataBrowser.WebRole/Views/Request/New.cshtml