Git Product home page Git Product logo

rdf2smw's Introduction

rdf2smw

CircleCI Test Coverage Go Report Card Status Code Climate Rating Code Climate Issues GoDoc

Updates

Sep 4, 2017: Our paper on RDFIO and rdf2smw was just published! If you use rdf2smw in scientific work, please cite:
Lampa S, Willighagen E, Kohonen P, King A, Vrandečić D, Grafström R, Spjuth O
RDFIO: extending Semantic MediaWiki for interoperable biomedical data management
Journal of Biomedical Semantics. 8:35 (2017). DOI: 10.1186/s13326-017-0136-y.

Sep 30, 2016: rdf2smw was covered in a talk at SMWCon in Frankfurt, Sep 2016. See: Talk page, Slides, Video.

Import / convert RDF data into a Semantic MediaWiki

A commandline tool to convert from RDF triples to Semantic MediaWiki facts in MediaWiki XML export format to be used with MediaWiki's built-in XML import feature.

This allows you to quickly and simply populate a Semantic MediaWiki page structure, from an RDF data file.

It is written in Go for better performance than PHP. The latest version processes triples into pages in the order of ~55K triples/sec converted into ~13K pages/sec on an 2014 i5 Haswell dual core processor, to give an idea.

rdf2smw is very similar to the RDF import function in the RDFIO Semantic MediaWiki extension, but takes another approach: Whereas RDFIO converts RDF to wiki pages and imports them in the same go, rdf2smw first converts RDF to an XML file outside of PHP (for better performance), and then importing using MediaWiki's built-in import function.

Status: The tool is pretty much feature complete, including ability to write facts via template calls if a categorization (via owl:Class or rdf:type) of the subject can be done. What is lacking is more options to fine-tune things. Right now you'll have to modify the source code yourself if you need any customization. Hope to address this in the near future.

Dependencies

The tool itself does not have any dependencies, apart from a unix-like operating system. For importing the generated XML dump file to make sense though, you will need a web server, PHP, MediaWiki and Semantic MediaWiki.

An automated virtualbox generation script (so valled "vagrant box"), with all of this, plus the RDFIO extension, can be found here, and is highly recommended, if you don't have a MediaWiki / SemanticMediawiki installation already!

Installation

For linux 64 bit:

  1. Download the file rdf2smw_linux64.gz, on the latest release.
  2. Unpack it with: gunzip rdf2smw_linux64.gz
  3. Call it, on the commandline (see the usage section below).

Usage

Call the rdf2smw binary, specifying a file with triples in n-triples or turtle format, with the --in flag, and an output file in XML format with the --out flag, like so:

./rdf2smw --in triples.nt --out semantic_mediawiki_pages.xml

In addition to the specified output file, there will be separate files for templates and properties, named similar to the main output file, but replacing .xml with _templates.xml and _properties.xml respectively.

These XML files can then be imported into MediaWiki / Semantic MediaWiki, via the importDump.php maintenance script, located in the maintenance folder under the main mediawiki folder.

php <wikidir>/maintenance/importDump.php semantic_mediawiki_pages_templates.xml
php <wikidir>/maintenance/importDump.php semantic_mediawiki_pages_properties.xml
php <wikidir>/maintenance/importDump.php semantic_mediawiki_pages.xml

Note that the order above is highly recommended (templates, then properties, then the rest), so as to avoid unnecessary re-computing of semantic data after the import is done.

Architecture

Find below a schematic illustration of the flow-based programming process graph of the rdf2smw program:

Flow-based programming diagram of rdf2smw

Illustration created with drawfbp

Known limitations

Only N-triples is supported as input format right now. We plan to add more formats shortly.

Technical notes

rdf2smw is based on the FlowBase flow-based programming micro-framework.

Acknowledgements

rdf2smw makes heavy use of Petter Goksøyr Åsen's awesome RDF parsing library.

rdf2smw's People

Contributors

samuell avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.