Seems to be failing in finding module within repository

-bash-4.1$ [ERROR] Failed to execute goal on project live-mirror: Could not resolve dependencies for project org.dbpedia:live-mirror:jar:1.1-SNAPSHOT: Failed to collect dependencies at com.openlink.virtuoso:virtjdbc4:jar:7-20140918: Failed to read artifact descriptor for com.openlink.virtuoso:virtjdbc4:jar:7-20140918: Could not transfer artifact com.openlink.virtuoso:virtjdbc4:pom:7-20140918 from/to aksw (http://maven.aksw.org/repository/internal): Connect to maven.aksw.org:80 [maven.aksw.org/139.18.2.226] failed: Connection timed out -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException

Lately, the liveSyn.sh is failing with
[INFO LiveSync] Up-to-date with last published changeset, sleeping for a while ;)
-bash-4.1$ [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.3.2:java (default-cli) on project live-mirror: An exception occured while executing the Java class. null: InvocationTargetException: File ./lastPublishedFile.txt not fount! ./lastPublishedFile.txt (Too many open files) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException

Any idea what might be wrong ?

Thx,
Hari

use dbpedia live feeder to get notifications on ontology updates.
ATM we update at regular intervals

Hi. Trying to get a local instance of DBpedia live running here.

However, it seems the latest dump file on http://live.dbpedia.org/dumps/ (dbpedia_2017_02_21.nt.gz) is only 123K in size, whereas the others are around 6G. Any idea on whether this is normal?

i.e., if I load this dump, will the scripts just pull everything in directly? Or do I start from the next-to-last dump? (dbpedia_2016_09_26.nt.gz)

In any case, a mention of this in the README would definitely help.

Thanks in advance!

Hello,
The below dependency fails when trying from http://maven.aksw.org/archiva/repository/internal .

com.openlink.virtuoso
virtjdbc4
7-20140918

A check at the site displays that the file is unavailable.
HTTP ERROR 404
Problem accessing /repository/internal/com/openlink/virtuoso/virtjdbc4/7-20140918/virtjdbc4-7-20140918.jar. Reason:
Resource does not exist

Can this be fixed ? or the Jar be made available so that I can run liveSync.sh .

Thanks,

• Hari

Is it possible to create dbpedia style data dumps from dbpedia live tables.

I am using an application which uses dbpedia data dumps. The ones available on downloads page are a year old. dbpedia-live gives me access to more recent data. Is there a simple way to export this data as dumps similar to the ones available on downloads page?

Hi,

What is the difference between the "reinsert" and "add" operations in the syncing process. I looked at the codebase, in particular the ChangesetExecutor.java file and the two seem to perform the same SPARQL 'INSERT DATA INTO' operation. My assumption is that 'reinserted' updates a triple statement. So if the fact <person_uri> :hasAge "12" exists, a reinserted file with the statement <person_uri> :hasAge "15" will update the literal value of property :hasAge to "15. The reason I'm asking is because I'm trying to repurpose this code to support SPARQL updates for my own personal Virtuoso server.

if (changeset.triplesReinserted() > 0) {
            boolean status_a = executeAction(changeset.getReinserted(), Action.ADD);
            logger.info("Patch " + changeset.getId() + " REINSERTED " + changeset.triplesReinserted() + " resources");
            status = status && status_a;
        }

if (changeset.triplesAdded() > 0) {
            boolean status_a = executeAction(changeset.getAdditions(), Action.ADD);
            logger.info("Patch " + changeset.getId() + " ADDED " + changeset.triplesAdded() + " triples");
            status = status && status_a;
        }

Can someone clarify this whether the two are indeed different operations?

First of all thanks for your great work. 👍

I don't know if this is the right place to report such issues.
While browsing manually and via sparql through live.dbpedia.org I found some inconsistencies:

• The page for Donald Trump seems broken (notice the very long dbo:abstract field)
• This guy has three birthdays. The main dbpedia instance returns the correct result for the same query

Is the meaning of the 4 parts of a changeset (added clear reinserted removed) documented somewhere?

• what's the difference between added and reinserted?
  https://github.com/dbpedia/dbpedia-live-mirror/blob/master/src/main/java/org/dbpedia/extraction/live/mirror/changesets/ChangesetExecutor.java#L53 seems the same to me
• I guess the 4 parts must be executed in the order shown in this source file?
• Are there any useful relations between these triples. (Eg I assume that a triple won't be removed and added as part of the same changeset)

Ideally, maybe there's a paper where this is described in detail?

2016-05-06-03-000017-bash-4.1$ sh bin/liveSync.sh
[INFO Global] Options file read successfully
[INFO ChangesetExecutor] Patch 2015-08-27-15-000201 CLEARED 160 resources
[INFO ChangesetExecutor] Patch 2015-08-27-15-000201 DELETED 977 triples
[WARN ChangesetExecutor] Error in query execution:
org.dbpedia.extraction.live.mirror.sparul.SPARULException: org.dbpedia.extraction.live.mirror.sparul.SPARULException: virtuoso.jdbc4.VirtuosoException: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD slice 0
at org.dbpedia.extraction.live.mirror.sparul.SPARULVosExecutor.execSQLWrapper(SPARULVosExecutor.java:74)
at org.dbpedia.extraction.live.mirror.sparul.SPARULVosExecutor.executeSPARUL(SPARULVosExecutor.java:29)
at org.dbpedia.extraction.live.mirror.changesets.ChangesetExecutor.executeSparulWrapper(ChangesetExecutor.java:140)
at org.dbpedia.extraction.live.mirror.changesets.ChangesetExecutor.executeAction(ChangesetExecutor.java:96)
at org.dbpedia.extraction.live.mirror.changesets.ChangesetExecutor.applyChangeset(ChangesetExecutor.java:54)
at org.dbpedia.extraction.live.mirror.LiveSync.main(LiveSync.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:293)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.dbpedia.extraction.live.mirror.sparul.SPARULException: virtuoso.jdbc4.VirtuosoException: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD slice 0
at org.dbpedia.extraction.live.mirror.sparul.SPARULVosExecutor.execSQL(SPARULVosExecutor.java:88)
at org.dbpedia.extraction.live.mirror.sparul.SPARULVosExecutor.execSQLWrapper(SPARULVosExecutor.java:40)
... 11 more
Caused by: virtuoso.jdbc4.VirtuosoException: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD slice 0
at virtuoso.jdbc4.VirtuosoResultSet.process_result(Unknown Source)
at virtuoso.jdbc4.VirtuosoResultSet.(Unknown Source)
at virtuoso.jdbc4.VirtuosoStatement.sendQuery(Unknown Source)
at virtuoso.jdbc4.VirtuosoStatement.executeQuery(Unknown Source)
at com.jolbox.bonecp.StatementHandle.executeQuery(StatementHandle.java:464)
at org.dbpedia.extraction.live.mirror.sparul.SPARULVosExecutor.execSQL(SPARULVosExecutor.java:86)
... 12 more
[WARN ChangesetExecutor] Tried to ADD 772 but failed, splitting into chunks to spot the error
[WARN ChangesetExecutor] Error in query execution:

[ERROR ChangesetExecutor] Cannot ADD triple:
http://dbpedia.org/resource/Alexander_Tachie_Mensah http://dbpedia.org/ontology/wikiPageExtracted "2015-08-27T13:24:03Z"^^http://www.w3.org/2001/XMLSchema#dateTime .