Git Product home page Git Product logo

mysos's Introduction

Mysos

Mysos is an Apache Mesos framework for running MySQL instances. It dramatically simplifies the management of a MySQL cluster and is designed to offer:

  • Efficient hardware utilization through multi-tenancy (in performance-isolated containers)
  • High reliability through preserving the MySQL state during failure and automatic backing up to/restoring from HDFS
  • An automated self-service option for bringing up new MySQL clusters
  • High availability through automatic MySQL master failover
  • An elastic solution that allows users to easily scale up and down a MySQL cluster by changing the number of slave instances

Mysos is also being proposed as a project in the Apache Incubator.

Documentation

A user guide is available. Documentation improvements are always welcome, so please send patches our way.

Getting Involved

The project maintains an IRC channel, #mysos on irc.freenode.net

License

Licensed under the Apache License, Version 2.0: http://www.apache.org/licenses/LICENSE-2.0

Requirements

  • Python 2.7
  • Mesos Python bindings

Building

Build status on Travis CI

Building/Downloading Mesos Python Bindings

Mysos uses Mesos Python bindings which consist of two Python packages. mesos.interface is on PyPI and gets automatically installed but mesos.native is platform dependent. You need to either build the package on your machine (instructions) or download a compiled one for your platform (e.g. Mesosphere hosts the eggs for some Linux platforms).

Since pip doesn't support eggs, you need to convert eggs into wheels using wheel convert, then drop them into the 3rdparty folder. See the README file for more information.

Building Mysos

Mysos mainly consists of two components that are built and deployed separately.

  • mysos_scheduler: The scheduler that connects to Mesos master and manages the MySQL clusters.
  • mysos_executor: The executor that is launched by Mesos slave (upon mysos_scheduler's request) to carry out MySQL tasks.

One way to package these components and their dependencies into a self-contained executable is to use PEX. This allow Mysos components to be launched quickly and reliably. See End-to-end test using PEX for an example of packaging and deploying the executor using PEX.

Testing

Unit Tests

Make sure tox is installed and just run:

tox

The unit tests don't require the mesos.native package to be available in 3rdparty. Tox also builds the Mysos source package and drops it in .tox/dist.

End-to-end Test on a Local Mesos Cluster and PEX

Build/download the mesos.native package and put it in 3rdparty and then run:

tox -e pex

This test demonstrates how to package a PEX executor and use it to launch a fake MySQL cluster on a local Mesos cluster.

End-to-end Test on a Real Mesos Cluster in a Vagrant VM

The Vagrant test uses the sdist Mysos package in .tox/dist so be sure to run tox first. Then:

vagrant up

# Wait for the VM and Mysos API endpoint to come up (http://192.168.33.17:55001 becomes available).

./vagrant/test.sh

test.sh verifies that Mysos successfully creates a MySQL cluster and then deletes it.

mysos's People

Contributors

xujyan avatar

Watchers

Yongbok Kim avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.