Git Product home page Git Product logo

xcache's Introduction

OSG XCache packaging

This repository is the OSG implementation of an XCache (XRootD Caching Proxy) setup. XCache allows one to setup a "cache" server which saves frequently-accessed files at a specified "origin" to local storage, allowing repeated accesses of the same resource to be served without having to transfer them multiple times over the wide-area-network.

XCache is not a generic HTTP cache. Files in the cache do not expire, nor are there integrity checking mechanism such as HTTP's ETag. Unlike many HTTP caches, it can stream partial responses: if the client requests only a few bytes from a multi-gigabyte resource, XCache will send the response before the full download completes.

XCache installation is covered in the OSG documentation

Features

The OSG packaging features:

  • Data can be exported via the HTTP, HTTPS, and Xrootd protocols.
  • Configurations for both running an origin and running a cache.
  • Integrated authentication and authorization for caches.
  • Usage monitoring integrated with OSG's monitoring services.

XCache Consistency Check

This is an experimental tool used to look for corrupted ROOT files within an XCache server. Only enable this service if you know what you are doing.

Before enabling the service, plese take a look to the configuration file located at: /etc/xrootd/xcache-consistency-check.cfg

To enable this service execute:

systemctl start xcache-consistency-check.timer

xcache's People

Contributors

bbockelm avatar brianhlin avatar ddavila0 avatar djw8605 avatar edquist avatar efajardo avatar illingwo avatar ivukotic avatar jthiltges avatar lincolnbryant avatar matyasselmeci avatar mwestphall avatar robrwg avatar sthapa avatar taburaad avatar zvada avatar

Stargazers

 avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

xcache's Issues

Rip out management routines in stashcache script

The stashcache script (https://github.com/opensciencegrid/StashCache-Daemon/blob/master/src/stashcache) was meant to be a way to remotely manage Xrootd servers and have a local monitor to automatically restart crashed daemons.

It didn't work out in the end - remote management is a lot deeper than just a script and the advent of systemd meant the the automatic restart was superfluous. I'm not sure anyone actually utilizes the script at this point.

However, the monitoring pieces are extremely useful and we'd love them to be revived. We should start removing the systemctl integration as in here:

https://github.com/opensciencegrid/StashCache-Daemon/blob/master/src/stashcache#L144

but keep the heartbeat thread that does the monitoring:

https://github.com/opensciencegrid/StashCache-Daemon/blob/master/src/stashcache#L33

We should break up the while True loop into a separate function call so the script can be called as a one-shot.

The intent is to have systemd-based systems run this as a periodic timer while running as a daemon in supervisord-based systems.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.