Git Product home page Git Product logo

simbapipelines's Introduction

Simba - Dynamic, parallel, reactive and high throughput pipelines

Note: Raptor version is work in progress. This read me will be updated with instruction in short time.

It has the following modules/submodule.

  • The framework is the module containing all classes needed for simba Framework(Such as Actors and Messages).

  • The akka is the submodule for akka based actors and messages. Simba is technology agnostice right now supports akka based pipelines.

  • The framework/framework project contains all platform logic agnostic of akka.

  • The simbasvc Service layer just to test simba deliverables. Not to be used by clients of simba.

Getting Started

  1. Clone the simba repo.

  2. Setting up you IDE: http://squbs/#/doc/Squbs/0.6.X/docs/mds/getting_started.md?hash=setting-up-your-project-in-the-ide

  3. Build the unicomplex by running "sbt clean compile publish" from the squbs-unicomplex directory. Note that steps 1 and 2 are not needed once we provide the squbs-unicomplex into the repo.

Release note:

1.6.0 (WIP)

  • Making Simba available to raptor

1.5.0

  • [Improvement] Moving timeoutHandler to JobMonitorActor
  • [Improvement] Creation of PostExecuteActor for each jobType (PostExecuteActor only be created if the job go to waiting state)
  • [Feature] Allow BusinessLogic to set fork Status of a job by using job.setForkComplete(boolean status) method
  • [Feature] Extend CircuitBreaker functionality to Aero AsynchHandler as well. Reference implementation on ApiJobProcessor
  • [Feature] adding new tool to get feed information by corelationid. You can call now a new endpoint /tools/corelationid/
  • [Improvement] Added more junits.

1.4.0

  • [Feature] Enable feed abort
  • [Feature] Adding tools to be able to query job based on status
  • [Feature] Enable feed timeout
  • [Improvement] Add Job type for the tools and change the startTime format

1.3.0

  • Introduce Job Timeout Feature.
  • Introduce Tools jars to help for debugging
  • Adding more CAL logging in various place.
  • Couple bug fixes.
  • Externalize Platform config
  • Remove CipJobTypeEnum from framework

1.2.1

  • Adding tools to view feed by feed id and jobs by job id.
  • upgrading squbs to 0.6.5 version
  • UTF_8 bug fix
  • Dead latter fix (extra messages after actor stop) - not harmful though.

simbapipelines's People

Contributors

josephchern avatar thesky90 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.