Git Product home page Git Product logo

dcache-s3-plugin's Introduction

S3 Nearline Storage Plugin for dCache

This plugin enables dCache to flush, stage and remove files to and from an S3 endpoint.

Building the plugin

To build this plugin, git and maven are needed. Please install these first if they're not already present.

Next, the sourcecode has to be downloaded using git clone https://github.com/dCache/dcache-s3-plugin.git. This creates a directory, called dcache-hsm-plugin, where the sourcecode can be found. To turn this sourcecode into a working plugin, it has to be built using Maven. mvn clean package compiles the code and packs it into a *.tar.gz-file which is located in target subdirectory. This file is needed for the next step.

Using the plugin with dCache

To use this plugin with dCache, extract the .tar.gz-file to /usr/local/share/dcache/plugins/ on a dCache pool. Restart the pool to load the plugin.

To verify that the plugin is loaded, navigate to the pool in the dCache admin shell and issue the command:

hsm show providers

The plugin should be listed as org.dcache.nearline-s3

To activate the plugin, create an HSM instance and pass the endpoint, access- and secret-key with it. There are two ways to do this:

Pass the information as key-value-pairs while creating the plugin, like this:

hsm create osm <name> org.dcache.nearline-s3 -endpoint=<endpoint-url> -access_key=<access-key> -secret_key=<secret-key>

Or create a .properties file, which contains the information, and pass the location to the HSM instance:

hsm create osm <name> org.dcache.nearline-s3 -conf_file=<path-to-.properties-file>

The .properties file has to contain the following information:

endpoint=<endpoint-url>
access_key=<access-key>
secret_key=<secret-key>

dcache-s3-plugin's People

Contributors

alrossi avatar svemeyer avatar

Stargazers

 avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Forkers

gexconus

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.