Git Product home page Git Product logo

dobef's Introduction

dobef

DOBEF (Data Oriented Benchmark Framework) provides a generalized framework to executed benchmarks for data-oriented distributed applications.

How it works

In order to benchmark a data-oriented distributed application, three classes must be written if not already enlisted in the 'impl/' package:

  • Specific Writer/Producer. It implements a 'Runnable' and writes/produces data.
  • Specific Reader/Consumer. It implements a 'Runnable' and reads/consumes data.
  • Specific Benchmark. It extends the 'Benchmark' class and represents the benchmark session pilot, driving the 'init', 'warmup' and run 'phases' of each benchmark.

Multiple Producers/Writers and Consumers/Readers can be detached for each specific benchmark. The probing activities and collection of statistcs is done OTB (Out of the Box) by the framework itself. Producers/Writers and Consumers/Readers can be distributed on different machines.

Example

Hazelcast Benchmark in local.

  • Writer Node Log and Statistics.
:configure
 DONE
:init
Nov 08, 2015 10:37:39 AM com.hazelcast.instance.DefaultAddressPicker
INFO: [LOCAL] [dev] [3.3.2] Prefer IPv4 stack is true.
Nov 08, 2015 10:37:39 AM com.hazelcast.instance.DefaultAddressPicker
INFO: [LOCAL] [dev] [3.3.2] Picked Address[192.168.122.1]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
Nov 08, 2015 10:37:39 AM com.hazelcast.spi.impl.BasicOperationScheduler
INFO: [192.168.122.1]:5701 [dev] [3.3.2] Starting with 4 generic operation threads and 4 partition operation threads.
Nov 08, 2015 10:37:39 AM com.hazelcast.system
INFO: [192.168.122.1]:5701 [dev] [3.3.2] Hazelcast 3.3.2 (20141023 - 7a40e93) starting at Address[192.168.122.1]:5701
Nov 08, 2015 10:37:39 AM com.hazelcast.system
INFO: [192.168.122.1]:5701 [dev] [3.3.2] Copyright (C) 2008-2014 Hazelcast.com
Nov 08, 2015 10:37:39 AM com.hazelcast.instance.Node
INFO: [192.168.122.1]:5701 [dev] [3.3.2] Creating MulticastJoiner
Nov 08, 2015 10:37:39 AM com.hazelcast.core.LifecycleService
INFO: [192.168.122.1]:5701 [dev] [3.3.2] Address[192.168.122.1]:5701 is STARTING
Nov 08, 2015 10:37:42 AM com.hazelcast.cluster.MulticastJoiner
INFO: [192.168.122.1]:5701 [dev] [3.3.2] 


Members [1] {
	Member [192.168.122.1]:5701 this
}

Nov 08, 2015 10:37:42 AM com.hazelcast.core.LifecycleService
INFO: [192.168.122.1]:5701 [dev] [3.3.2] Address[192.168.122.1]:5701 is STARTED
 DONE
:warmUp
Nov 08, 2015 10:37:42 AM com.hazelcast.partition.InternalPartitionService
INFO: [192.168.122.1]:5701 [dev] [3.3.2] Initializing cluster partition table first arrangement...
 DONE - 90ms
:benchmark

Benchmark Summary- Data [64], Test(s) [100], Repetition(s) [2]
{
  elapsed[ms]        : 1407.0
  mean[us]           : 7025.4434550000005
  variance[us]       : 1.8004617006952386E7
  std deviation[us]  : 4243.184771719514
  min[us]            : 1931.0695
  max[us]            : 24392.4985
  95th percentile[us]: 15872.51885
}

:writeResults
 DONE

Versions

  • 1.0 Framework, plus Hazelcast and A-MQ benchmarks

dobef's People

Contributors

hailpam avatar peter-lawrey avatar

Stargazers

 avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

Forkers

peter-lawrey

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.