oaqa / helloqa Goto Github PK

Some tables contain id fields that are empty and superfluous. They need to be removed from the database to avoid confusion.

Hi,

I'm trying to get started with OAQA. My goal for now is a project that can answer basic questions as a stepping stone for more involved work (general knowledge would be preferred). Hence, I tried to compile HelloQA following the instructions (downloaded Gutenberg, extracted files, opened project in Eclipse 4.5.1, ran test.launch), but it throws java.lang.NoClassDefFoundErrors. I have been able to solve some by adding <dependency> <groupId>org.slf4j</groupId> <artifactId>slf4j-log4j12</artifactId> <version>1.7.13</version> </dependency> <dependency> <groupId>org.apache.lucene</groupId> <artifactId>lucene-core</artifactId> <version>3.6.0</version> </dependency> <dependency> <groupId>commons-fileupload</groupId> <artifactId>commons-fileupload</artifactId> <version>1.3</version> </dependency> to pom.xml

But I now get Phase: 2|retrieval-strategist> Exception in thread "main" java.lang.NoClassDefFoundError: javax/servlet/ServletRequest

Since I'm completely inexperienced with this pipeline: What can I do now? Did you make any assumptions? Right now I have set up neither UIMA, Indri, CSE nor any other OAQA projects. Was I supposed to?

Thanks in advance.

Best wishes,
Joe

Apply evaluation components from baseqa to helloqa for three different phases: keyterm extractor, retrieval strategist, and passage extractor.

Running this project as specified in the README fails for me giving the following error:
SQL error or missing database (no such table: cas)
I have looked into the sqlite db: oaqa-eval.db3 and there is in fact no table named cas, there is a cas_str table. This happened on both the master and prototype branches.

The output and stack trace are below:
[1] Execution failed for option: SimpleKeytermExtractor[persistence-provider:inherit: ecd.default-log-persistence-provider] after 0s
Aug 22, 2013 10:38:27 AM org.apache.uima.util.CasPool releaseCas
WARNING: The system tried to return a common analysis structure to the pool from which it was not checked out.
Aug 22, 2013 10:38:27 AM org.apache.uima.analysis_engine.impl.PrimitiveAnalysisEngine_impl callAnalysisComponentNext(523)
SEVERE: Exception occurred
org.apache.uima.analysis_engine.AnalysisEngineProcessException
at edu.cmu.lti.oaqa.ecd.phase.BasePhase.next(BasePhase.java:185)
at edu.cmu.lti.oaqa.ecd.phase.BasePhase.next(BasePhase.java:73)
at org.apache.uima.analysis_engine.impl.PrimitiveAnalysisEngine_impl.callAnalysisComponentNext(PrimitiveAnalysisEngine_impl.java:500)
at org.apache.uima.analysis_engine.impl.PrimitiveAnalysisEngine_impl$AnalysisComponentCasIterator.next(PrimitiveAnalysisEngine_impl.java:613)
at org.apache.uima.analysis_engine.asb.impl.ASB_impl$AggregateCasIterator.processUntilNextOutputCas(ASB_impl.java:569)
at org.apache.uima.analysis_engine.asb.impl.ASB_impl$AggregateCasIterator.(ASB_impl.java:409)
at org.apache.uima.analysis_engine.asb.impl.ASB_impl.process(ASB_impl.java:342)
at org.apache.uima.analysis_engine.impl.AggregateAnalysisEngine_impl.processAndOutputNewCASes(AggregateAnalysisEngine_impl.java:267)
at org.apache.uima.analysis_engine.impl.AnalysisEngineImplBase.process(AnalysisEngineImplBase.java:267)
at edu.cmu.lti.oaqa.ecd.driver.SimplePipelineRev803.runPipeline(SimplePipelineRev803.java:244)
at edu.cmu.lti.oaqa.ecd.driver.SimplePipelineRev803.runPipeline(SimplePipelineRev803.java:154)
at edu.cmu.lti.oaqa.ecd.driver.ECDDriver.run(ECDDriver.java:66)
at edu.cmu.lti.oaqa.ecd.driver.ECDDriver.main(ECDDriver.java:96)
Caused by: org.apache.uima.analysis_engine.AnalysisEngineProcessException
at edu.cmu.lti.oaqa.ecd.phase.BasePhase.next(BasePhase.java:180)
... 12 more
Caused by: org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL []; SQL state [null]; error code [0]; [SQLITE_ERROR] SQL error or missing database (no such table: cas); nested exception is java.sql.SQLException: [SQLITE_ERROR] SQL error or missing database (no such table: cas)
at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:83)
at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:80)
at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:80)
at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:602)
at org.springframework.jdbc.core.JdbcTemplate.update(JdbcTemplate.java:811)
at org.springframework.jdbc.core.JdbcTemplate.update(JdbcTemplate.java:833)
at edu.cmu.lti.oaqa.cse.driver.phase.impl.JdbcPhasePersistenceProvider.insertExecutionTrace(JdbcPhasePersistenceProvider.java:29)
at edu.cmu.lti.oaqa.ecd.phase.BasePhase.insertExecutionTrace(BasePhase.java:278)
at edu.cmu.lti.oaqa.ecd.phase.BasePhase.process(BasePhase.java:195)
at edu.cmu.lti.oaqa.ecd.phase.BasePhase.next(BasePhase.java:175)
... 12 more

Add a simple passage extractor component to complete the baseqa pipeline implementation.

Currently we must specify the entire package prefix for descriptors such as jdbc.sqlite.cse.phase. But, sqlite or jdbc do not really have anything to do with cse.phase. We would like our naming scheme to reflect this loose coupling by having some way of inferring the database being used without having to explicitly specifying it in the descriptor.

Hi,

Sorry to trouble you before Thanks Giving.

It seems the
http://peace.isri.cs.cmu.edu:9080/solr/
server is not working.

Could you kindly fix that?

Have a good holiday!

Team 16

I want to know what is the real utility of oaqa-eval.db3 database. Can I build my QA pipeline without it?

Irrelevant entries, such bio related questions and traces (including private URL) can be found in some tables, like funneled_traces and inputelement in the oaqa-eval.db3, which should be removed.

NoClassDefFoundError: org/slf4j/LoggerFactory
at org.apache.solr.core.SolrResourceLoader.(SolrResourceLoader.java:66)

Booted in a fresh Kepler Eclipse. First boot got that error message.
Then tried a mvn clean install and re-run. Nothing changed.