Git Product home page Git Product logo

cqsim's Introduction

CQSim - a discrete-event driven scheduling simulator

CQSim is an open-source, discrete-event driven cluster scheduling simulator. It was originated from QSim, an discrete-event driven scheduling simulator developed for the production batch scheduler Cobalt deployed at Argonne Leadership Computing Facility in 2009 [3]. In 2011-2012, Qsim was evolved into CQSim by adding more functionalities and features. CQSim was originally developed by Dongxu Ren and Wei Tang (version 1.0), and later was improved by Xu Yang and Yuping Fan (master branch) [1,2], all under the supervision of Zhiling Lan.

CQSim is written in Python, and is formed by several modules including job module, node module, scheduling policy module, etc. Each module is implemented as a class. Its design principles are reusability, extensibility, and efficiency. CQSim takes job events from a workload trace (e.g., the SWF format from Parallel Workload Archive. Based on the events, the simulator emulates job submission, allocation, and execution according to a specific scheduling policy.

CQSim has been extensively validated by comparing its simulation results with the real system traces listed in the well-known Parallel Workload Archive (https://www.cs.huji.ac.il/labs/parallel/workload/). It was also assessed with the scheduling simulator developed by Dan Tsafrir. A number of system-level and user-level metrics, e.g., makespan, system utilization rate, job wait time, job slowdown, etc., were used in the quantitative validation.

Note: if you use CQSim in your work, please cite the following papers:

  1. X. Yang, Z. Zhou, S. Wallace, Z. Lan, W. Tang, S. Coghlan, and M. Papka, "Integrating Dynamic Pricing of Electricity into Energy Aware Scheduling for HPC Systems", Proc. of SC'13, 2013.[http://www.cs.iit.edu/~lan/publications/sc13_final.pdf]
  2. Y. Fan, Z. Lan, P. Rich, W. Allcock, M. Papka, B. Austin, and D. Paul, "Scheduling beyond CPUs for HPC", Proc. of HPDC'19, 2019. [http://www.cs.iit.edu/~lan/publications/hpdc19-final.pdf]
  3. W. Tang, Z. Lan, N. Desai, and D. Buettner, “Fault-aware Utility-based Job Scheduling on Blue Gene/P Systems,” Proc of IEEE Cluster, 2009. [http://www.cs.iit.edu/~lan/publications/ipdps11_wei.pdf]

Getting started: Run A Simple Example

python cqsim.py -j test.swf -n test.swf

cqsim's People

Contributors

zlan-uic avatar yfan000 avatar zzheng1999 avatar bli70 avatar

Stargazers

Hang avatar Lang Liu avatar chenzhibin avatar Nathaniel Hudson avatar  avatar Shambhawi Sharma avatar wangxso avatar  avatar Narges Mehran avatar Velimice avatar  avatar nyovelt avatar  avatar Siyuan Zhang avatar  avatar ChaoSong avatar 齐豪 avatar Graeme Holliday avatar  avatar Cloud_F96 avatar zsj_thu avatar Canyu Chen avatar Matthew T. Dearing avatar Minglu Zhao avatar SunMahatma avatar  avatar Hoàng Lê Hải Thanh avatar Ryan D. Lewis avatar tangrui avatar Zhengchun Liu avatar xiaopu peng avatar

Watchers

Matthew T. Dearing avatar Melanie Cornelius avatar  avatar  avatar

cqsim's Issues

About adding NVIDIA GPU resource

Thank you so much for sharing the source code of CQSim, which is quite useful to simulate the scheduling process.
However, I want to extend the resource type to simulate, such as Nvidia GPU.
So I wanna know that have you did some research on other resource-type simulations except CPUs?
If you do interest in the other resource-type simulations, I really hope to communicate if you want.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.