In qa.commons, there are 2 different ways to fire queries to an endpoint, SPARQL and SPARQLExecutor. This becomes tedious to keep clean, especially when both share the same (hardcopied) code.
Consider merging the functionality in favor of SPARQL.

There are a lot of // TODO messages annotate for writing a unit test. Do so.

As another SPARQL generator we could possibly use https://github.com/okbqa/rocknrole

Hello,

I'm getting the a NoClassDefFoundError exception when trying to deploy hawk using docker. I tried adding the jena-arq dependency but then different classes appeared missing. What could be the problem ? I'm using the latest version of the source code

This is the entire stacktrace during spring startup:

Error starting ApplicationContext. To display the auto-configuration report re-run your application with 'debug' enabled.
Application startup failed
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'gerbilQABenchmarking' defined in file [/home/ciadmin/NLIWOD/qa.hawk/target/classes/org/aksw/hawk/webservice/GerbilQABenchmarking.class]: Instantiation of bean failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.aksw.hawk.webservice.GerbilQABenchmarking]: Constructor threw exception; nested exception is java.lang.NoClassDefFoundError: org/apache/jena/riot/lang/ReaderRIOTRDFXML
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateBean(AbstractAutowireCapableBeanFactory.java:1110)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1054)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:512)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482)
	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:754)
	at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:866)
	at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:542)
	at org.springframework.boot.context.embedded.EmbeddedWebApplicationContext.refresh(EmbeddedWebApplicationContext.java:122)
	at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:761)
	at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:371)
	at org.springframework.boot.SpringApplication.run(SpringApplication.java:315)
	at org.springframework.boot.SpringApplication.run(SpringApplication.java:1186)
	at org.springframework.boot.SpringApplication.run(SpringApplication.java:1175)
	at org.aksw.hawk.webservice.WebApplication.main(WebApplication.java:9)
Caused by: org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.aksw.hawk.webservice.GerbilQABenchmarking]: Constructor threw exception; nested exception is java.lang.NoClassDefFoundError: org/apache/jena/riot/lang/ReaderRIOTRDFXML
	at org.springframework.beans.BeanUtils.instantiateClass(BeanUtils.java:154)
	at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:89)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateBean(AbstractAutowireCapableBeanFactory.java:1102)
	... 17 more
Caused by: java.lang.NoClassDefFoundError: org/apache/jena/riot/lang/ReaderRIOTRDFXML
	at org.apache.jena.tdb.TDB.init(TDB.java:248)
	at org.apache.jena.tdb.sys.InitTDB.start(InitTDB.java:29)
	at org.apache.jena.system.JenaSystem.lambda$init$1(JenaSystem.java:111)
	at java.util.ArrayList.forEach(ArrayList.java:1255)
	at org.apache.jena.system.JenaSystem.forEach(JenaSystem.java:186)
	at org.apache.jena.system.JenaSystem.forEach(JenaSystem.java:163)
	at org.apache.jena.system.JenaSystem.init(JenaSystem.java:109)
	at org.apache.jena.rdf.model.ModelFactory.<clinit>(ModelFactory.java:49)
	at org.aksw.qa.annotation.index.IndexDBO_classes.index(IndexDBO_classes.java:115)
	at org.aksw.qa.annotation.index.IndexDBO_classes.<init>(IndexDBO_classes.java:63)
	at org.aksw.hawk.nlp.Annotater.<init>(Annotater.java:27)
	at org.aksw.hawk.controller.PipelineStanford.<init>(PipelineStanford.java:55)
	at org.aksw.hawk.webservice.GerbilQABenchmarking.<init>(GerbilQABenchmarking.java:28)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
	at org.springframework.beans.BeanUtils.instantiateClass(BeanUtils.java:142)
	... 19 more
Caused by: java.lang.ClassNotFoundException: org.apache.jena.riot.lang.ReaderRIOTRDFXML
	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	... 37 more

Use mvn dependency:analyze to analyze the pom and make the build smaller.

Adapt deployment and indexing to fuseki 2

https://jena.apache.org/documentation/fuseki2/

#69

Hello,
The SPARQL endpoints required by HAWK (http://139.18.2.164:3030/ds/sparql or http://titan.informatik.uni-leipzig.de:3030/ds/) are not available, and neither is the demo on http://titan.informatik.uni-leipzig.de:8181/.

Connexion to ws.okbqa.org:7042 is also impossible, preventing maven installation (it is required by the unit tests)

hello,
when I open http://hawk.aksw.org and try to search it doesn't respond!

Regards
Rawan

Instead of using a local model use a Stanford Server http://139.18.2.164:9000/. This should decrease the jar size and building and starting time.

There is no file for lcquad.json in the jar of the latest release. Please check and deploy a new version.
@TortugaAttack

Delete all variable renaming form source code. For example, line 200 ff in RecursiveSPARQLQueryBuilder

As you can see here (http://gerbil-qa.aksw.org/gerbil/experiment?id=201606010001) SINA gets a score of 1 at QALD 3. That is, the questions have no answers. Please add the correct dataset to qa.datasets.

Answer tag is missing in response. Reason seems to be issue in Sparql end points.
log.pdf

My old script does not work anymore, so either we fix that script or make this project run https://github.com/dice-group/SFGeneratorTemp

if [ ! -f "redirect_labels.ttl" ];
then
	sort labels_en.ttl > labels_en.ttl.sorted 
	sort transitive_redirects_en.ttl  > transitive_redirects_en.ttl.sorted
	join -1 1 -2 1 labels_en.ttl.sorted transitive_redirects_en.ttl.sorted  > join.tsv
	cat join.tsv | awk '{sub("<http://www.w3.org/2000/01/rdf-schema#label>","",$0);sub("<http://dbpedia.org/ontology/wikiPageRedirects>","",$0); sub(" .  "," ",$0); print $0}'| awk -F">  \"" '{print "\""$2 }'| awk -F"@en <" '{print $2 " <http://www.w3.org/2000/01/rdf-schema#label> " $1}' | awk '{sub(" . "," ",$0);  print "<"$0 " . " }' > redirect_labels.ttl
fi 

Add to HAWK: http://liris.cnrs.fr/~pchampin/enseignement/semweb/_static/articles/unger_2012.pdf

• Make a subsection in the README to point to papers using NLIWOD (e.g. https://doi.acm.org/10.1145/3178876.3186023, https://github.com/dice-group/goose)
• Add Codacy and CodeCov badge
• Add to the annotation module the comparative module https://github.com/LukasBluebaum/QALD-Mini-Project
• Make the QALDWriter (used to write QALD JSON files like https://github.com/ag-sc/QALD/blob/master/9/data/qald-9-train-multilingual.json) more obvious and beautiful
• Write a class to create Knowledge cards utility like here http://chat.dbpedia.org
• Update all ReadMe files in all folders
• Fix other issues
• Merge all forks
• Merge all pull requests
• Remove Hawk by adding the subdirectory as a new branch to https://github.com/dice-group/hawk
• Remove watodo folder
• Merge logging pull request
• Search for all FIXME and TODO annotations in Code and try to fix them
• Convert all main() methods to unit tests where appropriate or delete them

@lukas fühl dich frei hier weitere Checkboxes hinzuzufügen

Hello, I'm trying to familiarize myself with HAWK and have encountered some problems.
Executing HAWK using mvn spring-boot:run worked well, but unfortunately I have yet to get back a correct answer, e.g. the answer for the query localhost:8181/simple-search?query=What is the capital of Spain ? was http://dbpedia.org/resource/Captain_Alatriste (At least this was found under the answer key) which is obviously wrong. I have attached the complete result for reference: response.txt . My question is now: Did I do something wrong or is this a known issue?

After having run index_fuseki.sh as suggested in the qa.hawk/deploy-scripts/README.md I tried to unzip the file I downloaded from ( http://139.18.2.164/rusbeck/hawk/index_2016-04.zip), which was not possible and returned the following:

  End-of-central-directory signature not found.  Either this file is not
  a zipfile, or it constitutes one disk of a multi-part archive.  In the
  latter case the central directory and zipfile comment will be found on
  the last disk(s) of this archive.
unzip:  cannot find zipfile directory in one of index_2016-04.zip or
        index_2016-04.zip.zip, and cannot find index_2016-04.zip.ZIP, period.

I don't think the file got corrupted while I downloaded it, because I downloaded it muliple times.

Building and running the docker image for the Fuseki server however was successful.
Which brings me to the last question: Does hawk automatically search for this fuseki server on port 3030 or do I have to configure this somewhere?

Build in https://github.com/ag-sc/matoll for having more surface forms at classes, relations and so on

Fix the demo and redeploy to titan via docker

When the following two dependencies are excluded, it works fine.

org.springframework.boot
spring-boot-starter-web


org.springframework.boot
spring-boot-starter-test

These dependencies were added in the following commit. Added knowledge card utility

f512d9d

@LukasBluebaum Could you please tell me if these two dependencies are needed?

Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/jena/tdb/store/bulkloader2/CmdNodeTableBuilder : Unsupported major.minor version 52.0

above error should happen when execute:
$APACHE_JENA_BIN/tdbloader2 --loc=hawk_data_10-2015_dbpediatbd dbpedia_2015-10.owl disambiguations_en.ttl instance_types_en.ttl long_abstracts_en.ttl pnd_en.ttl labels_en.ttl mappingbased_objects_en.ttl mappingbased_literals_en.ttl persondata_en.ttl specific_mappingbased_properties_en.ttl transitive_redirects_en.ttl en_surface_forms.ttl pagerank_en_2015-10.ttl redirect_labels.ttl

java -Xmx16G -cp $JENA_FUSEKI_JAR jena.textindexer --desc=fuseki_hawk_assembler.ttl

Remove the CoreNLP dependency at all and remove or replace all classes using it to decrease package size

mapDatasetToPath() method could return only one InputStream now. It should be extended to return a list of Inputstreams.

Create a QALD JSON writer as a util class

https://github.com/yuvalpinter/LiveQAServerDemo/blob/master/src/org/trec/liveqa/TrecLiveQaDemoServer.java

Build in a reader/writer for the format above in QA commons to enable fast engagement with trec 2016/2017 open QA challenge in the future

Update NLIWOD to use Spring 2.0

Please implement QALD 6 test multilingual and hybrid in qa-commons

Hello,
I'm really interested in getting into HawK
However, when tried to test the system locally, i found some differences between the published paper and the documentation on gitHub

So on Hawk online QA website, are the used tools and techniques the ones on the published paper?

If they are not could you plz tell which DBpedia version, parsing tool, free text resources, pruning techniques and ranking techniques that are used.

Any clarification would be much appreciated

Hi,

I am trying to build Q$A machine reading comprehension model for spanish language.

but i am not finding dataset similar to Squad . is there any dataset do we have ? please share some link.

Thanks.

Is it possible to change to Environment variables instead of fixed hardcoded absolute path? (z.B /home/datascience/.....). WE have to manually change path to run scripts in case code is not created in that path.

https://twitter.com/RishirajSahaRoy/status/1374266512660307974 see if we can include

Instead of having in each QALD loading (for json, xml,...) a method which trys to derive the current results, create one method syncingResults(List<IQuestion> questions).

Check for all modules whether the builds run through and the latest releases are working.

For example

• qa.commons 0.4.6 build broken and latest release has no source files
• qa.systems not building