Git Product home page Git Product logo

cmekgcrawler's Introduction

关于本项目(更新于2023/1/5)

近短时间,不知道出于什么原因,本项目的star开始增加,问题也随之而来,因此更新一份说明:

  • CMeKg项目的网站已经无法访问,由于本项目的代码是爬虫代码,因此代码已经失效了。
  • 基于第一点,目前本项目只有数据库文件能使用了,没有必要将项目运行起来。
  • 本人基于此爬虫的项目只是本科的毕业设计,并没有高深的算法在里面,因此直接下载数据库使用即可。
  • 最后,感谢大家对项目的认可。

Describe

The project includes 140000 entities and nearly 700000 relationships

Relationship

DISEASE

SYMPTOM

DRUG

TREATMENT

Quick Start

Dependencies

  • Java 8 and up
  • Maven 3.6.3 and up
  • Neo4j
  • IDEA

How To Start

DownLoad Source Code

git clone https://gitee.com/huyuanxin/CMeKGCrawler
git clone https://github.com/huyuanxin/CMeKGCrawler

Import Code To IDEA

Configuration Database Information

#neo4j
spring.data.neo4j.uri=bolt://ip:port
spring.data.neo4j.username=username
spring.data.neo4j.password=password

Run Application

  • Run KnowledgeCrawlerApplication.java.java

References

If you used Knowledge Crawler in your research, please quote it in the following format:

@Software{CollegeCrawler,
  author = {huyuanxin,luhaoyi,zhangtingting},
  title = {{CMeKGCrawler: CMeKGCrawler}},
  year = {2021},
  url = {https://github.com/huyuanxin/CMeKGCrawler},
}

Disclaimers

Please do not apply Knowledge Crawler to any work that may violate the legal provisions and moral constraints. Please use Knowledge Crawler friendly, abide by the spider agreement, and do not use Knowledge Crawler for any illegal purpose. If you choose to use Knowledge Crawler, you will abide by this agreement. The author will not bear any legal risks and losses caused by your violation of this agreement, and all consequences will be borne by you.

Database

如果不想自己进行爬取,可以自行在此下载
项目:https://github.com/huyuanxin/MKGS
链接:https://pan.baidu.com/s/1I9GG4zD2rULAKA6Mb365LQ 提取码:MKGS
适配Neo4j v5.2&Neo4j v4.4
链接: https://pan.baidu.com/s/1UPtlNCEtH2P05LgG1veFEw 提取码: MKGS

cmekgcrawler's People

Contributors

huyuanxin avatar luhaoyi avatar ztt-277 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar

cmekgcrawler's Issues

环境:win10,JKD8,neo4j-community-3.5.35。导入neo4j.dump成功,启动失败

D:\neo4j-community-3.5.35\bin>neo4j-admin load --from=D:/neo4j.dump --database=graph.db --force
Done: 148 files, 551.6MiB processed.

D:\neo4j-community-3.5.35\bin>neo4j.bat console
2022-11-04 02:59:07.152+0000 INFO ======== Neo4j 3.5.35 ========
2022-11-04 02:59:07.162+0000 INFO Starting...
2022-11-04 02:59:08.955+0000 ERROR Failed to start Neo4j: Starting Neo4j failed: Component 'org.neo4j.server.database.LifecycleManagingDatabase@50ecde95' was successfully initialized, but failed to start. Please see the attached cause exception "Transaction logs contains entries with prefix 0, and the lowest supported prefix is 5. This indicates that the log files originates from an older version of neo4j, which we don't support migrations from.. At position LogPosition{logVersion=2, byteOffset=16} and entry version null". Starting Neo4j failed: Component 'org.neo4j.server.database.LifecycleManagingDatabase@50ecde95' was successfully initialized, but failed to start. Please see the attached cause exception "Transaction logs contains entries with prefix 0, and the lowest supported prefix is 5. This indicates that the log files originates from an older version of neo4j, which we don't support migrations from.. At position LogPosition{logVersion=2, byteOffset=16} and entry version null".
org.neo4j.server.ServerStartupException: Starting Neo4j failed: Component 'org.neo4j.server.database.LifecycleManagingDatabase@50ecde95' was successfully initialized, but failed to start. Please see the attached cause exception "Transaction logs contains entries with prefix 0, and the lowest supported prefix is 5. This indicates that the log files originates from an older version of neo4j, which we don't support migrations from.. At position LogPosition{logVersion=2, byteOffset=16} and entry version null".
at org.neo4j.server.exception.ServerStartupErrors.translateToServerStartupError(ServerStartupErrors.java:45)
at org.neo4j.server.AbstractNeoServer.start(AbstractNeoServer.java:187)
at org.neo4j.server.ServerBootstrapper.start(ServerBootstrapper.java:124)
at org.neo4j.server.ServerBootstrapper.start(ServerBootstrapper.java:91)
at org.neo4j.server.CommunityEntryPoint.main(CommunityEntryPoint.java:32)
Caused by: org.neo4j.kernel.lifecycle.LifecycleException: Component 'org.neo4j.server.database.LifecycleManagingDatabase@50ecde95' was successfully initialized, but failed to start. Please see the attached cause exception "Transaction logs contains entries with prefix 0, and the lowest supported prefix is 5. This indicates that the log files originates from an older version of neo4j, which we don't support migrations from.. At position LogPosition{logVersion=2, byteOffset=16} and entry version null".
at org.neo4j.kernel.lifecycle.LifeSupport$LifecycleInstance.start(LifeSupport.java:473)
at org.neo4j.kernel.lifecycle.LifeSupport.start(LifeSupport.java:111)
at org.neo4j.server.AbstractNeoServer.start(AbstractNeoServer.java:180)
... 3 more
Caused by: java.lang.RuntimeException: Error starting org.neo4j.graphdb.facade.GraphDatabaseFacadeFactory, D:\neo4j-community-3.5.35\data\databases
at org.neo4j.graphdb.facade.GraphDatabaseFacadeFactory.initFacade(GraphDatabaseFacadeFactory.java:232)
at org.neo4j.graphdb.facade.GraphDatabaseFacadeFactory.newFacade(GraphDatabaseFacadeFactory.java:148)
at org.neo4j.server.database.CommunityGraphFactory.newGraphDatabase(CommunityGraphFactory.java:41)
at org.neo4j.server.database.LifecycleManagingDatabase.start(LifecycleManagingDatabase.java:90)
at org.neo4j.kernel.lifecycle.LifeSupport$LifecycleInstance.start(LifeSupport.java:452)
... 5 more
Caused by: org.neo4j.kernel.lifecycle.LifecycleException: Component 'org.neo4j.kernel.NeoStoreDataSource@6ff65192' was successfully initialized, but failed to start. Please see the attached cause exception "Transaction logs contains entries with prefix 0, and the lowest supported prefix is 5. This indicates that the log files originates from an older version of neo4j, which we don't support migrations from.. At position LogPosition{logVersion=2, byteOffset=16} and entry version null".
at org.neo4j.kernel.lifecycle.LifeSupport$LifecycleInstance.start(LifeSupport.java:473)
at org.neo4j.kernel.lifecycle.LifeSupport.start(LifeSupport.java:111)
at org.neo4j.kernel.impl.transaction.state.DataSourceManager.start(DataSourceManager.java:116)
at org.neo4j.kernel.lifecycle.LifeSupport$LifecycleInstance.start(LifeSupport.java:452)
at org.neo4j.kernel.lifecycle.LifeSupport.start(LifeSupport.java:111)
at org.neo4j.graphdb.facade.GraphDatabaseFacadeFactory.initFacade(GraphDatabaseFacadeFactory.java:227)
... 9 more
Caused by: java.lang.RuntimeException: Error reading transaction logs, recovery not possible. To force the database to start anyway, you can specify 'unsupported.dbms.tx_log.fail_on_corrupted_log_files=false'. This will try to recover as much as possible and then truncate the corrupt part of the transaction log. Doing this means your database integrity might be compromised, please consider restoring from a consistent backup instead.
at org.neo4j.kernel.recovery.Recovery.throwUnableToCleanRecover(Recovery.java:160)
at org.neo4j.kernel.recovery.LogTailScanner.findLogTail(LogTailScanner.java:147)
at org.neo4j.kernel.recovery.LogTailScanner.getTailInformation(LogTailScanner.java:260)
at org.neo4j.kernel.impl.transaction.log.LogVersionUpgradeChecker.check(LogVersionUpgradeChecker.java:48)
at org.neo4j.kernel.NeoStoreDataSource.start(NeoStoreDataSource.java:349)
at org.neo4j.kernel.lifecycle.LifeSupport$LifecycleInstance.start(LifeSupport.java:452)
... 14 more
Caused by: org.neo4j.kernel.impl.transaction.log.entry.UnsupportedLogVersionException: Transaction logs contains entries with prefix 0, and the lowest supported prefix is 5. This indicates that the log files originates from an older version of neo4j, which we don't support migrations from.. At position LogPosition{logVersion=2, byteOffset=16} and entry version null
at org.neo4j.kernel.impl.transaction.log.entry.LogEntryVersion.byVersion(LogEntryVersion.java:169)
at org.neo4j.kernel.impl.transaction.log.entry.VersionAwareLogEntryReader.readLogEntry(VersionAwareLogEntryReader.java:80)
at org.neo4j.kernel.impl.transaction.log.LogEntryCursor.next(LogEntryCursor.java:54)
at org.neo4j.kernel.recovery.LogTailScanner.findLogTail(LogTailScanner.java:99)
... 18 more
2022-11-04 02:59:08.960+0000 INFO Neo4j Server shutdown initiated by request

Results about CMeKGCrawler

I would like to ask, is the data crawled by the crawler to build the knowledge graph in the form of a triplet?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.