Git Product home page Git Product logo

mbrukman / vespa Goto Github PK

View Code? Open in Web Editor NEW

This project forked from vespa-engine/vespa

0.0 1.0 0.0 143.02 MB

The open big data serving engine. https://vespa.ai

Home Page: https://vespa.ai

License: Apache License 2.0

CMake 0.85% Java 56.08% Shell 0.37% Perl 0.32% C++ 41.51% C 0.10% ANTLR 0.01% HTML 0.28% Objective-C 0.02% Emacs Lisp 0.16% Python 0.09% Makefile 0.01% GAP 0.01% Ruby 0.02% PigLatin 0.01% Roff 0.03% LLVM 0.01% Yacc 0.02% CSS 0.06% JavaScript 0.04%

vespa's Introduction

#Vespa

The open big data serving engine - Store, search, organize and make machine-learned inferences over big data at serving time.

This is the primary repository for Vespa where all development is happening. New production releases from this repository's master branch are made each weekday from Monday to Thursday.

Vespa build status: Vespa Build Status

Table of contents

Background

Use cases such as search, recommendation and personalization need to select a subset of data in a large corpus, evaluate machine-learned models over the selected data, organize and aggregate it and return it, typically in less than 100 milliseconds, all while the data corpus is continuously changing.

This is hard to do, especially with large data sets that needs to be distributed over multiple nodes and evaluated in parallel. Vespa is a platform which performs these operations for you with high availability and performance. It has been in development for many years and is used on a number of large internet services and apps which serve hundreds of thousands of queries from Vespa per second.

Install

Run your own Vespa instance: https://docs.vespa.ai/en/getting-started.html
Or deploy your Vespa applications to the cloud service: https://cloud.vespa.ai

Usage

  • The application created in the getting started guide is fully functional and production ready, but you may want to add more nodes for redundancy.
  • See developing applications on adding your own Java components to your Vespa application.
  • Vespa APIs is useful to understand how to interface with Vespa
  • Explore the sample applications
  • Follow the Vespa Blog for feature updates / use cases

Full documentation is available on https://docs.vespa.ai.

Contribute

We welcome contributions! See CONTRIBUTING.md to learn how to contribute.

If you want to contribute to the documentation, see https://github.com/vespa-engine/documentation

Building

You do not need to build Vespa to use it, but if you want to contribute you need to be able to build the code. This section explains how to build and test Vespa. To understand where to make changes, see Code-map.md. Some suggested improvements with pointers to code are in TODO.md.

Development environment

C++ and Java building is supported on CentOS 7. The Java source can also be built on any platform having Java 11 and Maven installed. Use the following guide to set up a complete development environment using Docker for building Vespa, running unit tests and running system tests: Vespa development on CentOS 7.

Build Java modules

export MAVEN_OPTS="-Xms128m -Xmx1024m"
./bootstrap.sh java
mvn install --threads 1C

Use this if you only need to build the Java modules, otherwise follow the complete development guide above.

Build RPM packages

See Building Vespa RPM for details.

License

Code licensed under the Apache 2.0 license. See LICENSE for terms.

vespa's People

Contributors

baldersheim avatar bjorncs avatar jonmv avatar freva avatar arnej27959 avatar mpolden avatar gjoranv avatar geirst avatar hakonhall avatar vekterli avatar bratseth avatar havardpe avatar aressem avatar tokle avatar olaaun avatar dybis avatar lesters avatar kkraune avatar thigm85 avatar smorgrav avatar toregge avatar henrhoi avatar bjormel avatar lonemeow avatar yngveaasheim avatar ollivir avatar frodelu avatar andreer avatar ldalves avatar mgimle avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.