Copyright 2016 Crown Copyright

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

Gaffer is built for very large graphs.

It's designed to be as flexible, scalable and extensible as possible, allowing for rapid prototyping and transition to production systems.

Gaffer does

• rapid query across very large numbers of entities and relationships,
• versatile query-time summarisation, filtering and transformation of data,
• in-database aggregation of rich statistical properties describing entities and relationships,
• scalable ingest at very high data rates and volumes,
• automated, rule-based data purge,
• fine grained data access and query execution controls.

Gaffer is built on Hadoop and Accumulo and is integrated with Spark for fast and flexible data analysis.

To get going with Gaffer, visit our getting started pages.

Gaffer is still under active development and isn't a finished product yet. There are still plenty of new features to be added and additional documentation to write. Please contribute.

We have a simple demo available to try that is based around a small uk road use dataset. Download the precompiled demo files from the last release here or build and run it from source code here.

There are more in depth examples of using the Java API on our wiki: Getting Started.

To build Gaffer run mvn clean install -Pquick in the top-level directory. This will build all of Gaffer's core libraries, the Accumulo store and some examples of how to load and query data and write other stores.

The Accumulo store needs to run on a Hadoop cluster with Accumulo installed. Instructions for installing Gaffer on Accumulo can be found on the wiki.

Our Javadoc can be found here.

We have some user guides on our wiki.