Git Product home page Git Product logo

dati-ckan-docker's Introduction

CKAN Docker based infrastructure

This project provides everything you need to run ckan plus a set of plugins for supporting Italian open data. It has been currently used only in testing environments but we think it can provide a good base for running a production service (please feel free to contribute with pull requests to this end).

Docker containers for ckan + plugin dcat + dcat-ap-it

Container images details:

- Ckan 2.6.2
	Extensions:
	0	"stats"
	1	"text_view"
	2	"image_view"
	3	"recline_view"
	4	"harvest"
	5	"ckan_harvester"
	6	"dcat"
	7	"dcat_rdf_harvester"
	8	"dcat_json_harvester"
	9	"dcat_json_interface"
	10	"dcatapit_pkg"
	11	"dcatapit_org"
	12	"dcatapit_config"
	13	"dcatapit_harvester"

- Solr 6.2.1

- Redis server v=4.0.0 sha=00000000:0 malloc=jemalloc-4.0.3 bits=64 build=77e2b28390619b67

- PostgreSQL 9.6

Follow these steps to run the Docker images:

  1. git clone https://github.com/italia/dati-ckan-docker.git
  2. cd dati-ckan-docker
  3. ./build_local.sh #it will build the images needed by docker-compoose
  4. docker-compose up -d # it will run all the needed containers
  5. ./init.sh # it will configure the plugins and it will create all the vocabolaries

Then you can open the ckan home http://localhost:5000. The init.sh script creates an admin user with the following credentials: ckanadmin/ckanpassword

CKAN Harvest

http://localhost:5000/harvest

Ckan starts automatically the harvesting function.

You can see logs during harvesting import with following command:

docker logs ckan -f

If there is some error during harvesting you can connect to the docker container, verify if some process are dead and restart the harvesting processes with following commands:

Connect to ckan container and verify the processes:

docker exec -it ckan /bin/bash

Once in the container run:

ps -ef

You need to find both these processes as output of the "ps -ef" command:

/usr/bin/python /usr/local/bin/paster --plugin=ckanext-harvest harvester gather_consumer -c /etc/ckan/default/ckan.ini

/usr/bin/python /usr/local/bin/paster --plugin=ckanext-harvest harvester fetch_consumer -c /etc/ckan/default/ckan.ini

If one of those processes is missing you can restart it with the following commands:

. /usr/lib/ckan/default/bin/activate

Then:

Either

nohup paster --plugin=ckanext-harvest harvester gather_consumer --config /etc/ckan/default/ckan.ini &

Or (you can run both in case both processes are missing)

nohup paster --plugin=ckanext-harvest harvester fetch_consumer --config /etc/ckan/default/ckan.ini &

dati-ckan-docker's People

Contributors

dgreco avatar piersoft avatar gvarisco avatar rasky avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.