unixjunkie / par Goto Github PK
View Code? Open in Web Editor NEWExecute shell commands in a parallel and/or distributed way
Home Page: https://savannah.nongnu.org/projects/par
License: GNU General Public License v3.0
Execute shell commands in a parallel and/or distributed way
Home Page: https://savannah.nongnu.org/projects/par
License: GNU General Public License v3.0
If you use this software, please cite the corresponding publication: @article{Berenger2010, author = {Berenger, Francois and Coti, Camille and Zhang, Kam Y. J.}, title = {{PAR: A PARallel And Distributed Job Crusher}}, doi = {10.1093/bioinformatics/btq542}, year = {2010}, journal = {Bioinformatics} } # you need to install Pyro, cf. http://pyro.sourceforge.net # (sudo yum install pyro _OR_ sudo aptitude install pyro) # On the server, TCP port 7766 must be open # TCP port 9090 must also be open if the server is also # the Pyro nameserver (default case) # if Pyro is not installed system wide, try this: export PYTHONPATH=~/usr/Pyro-3.10/build/lib # Some usage examples: # run in parallel commands from test_parallel.input cat test_parallel.input | ./parallel.py -i /dev/stdin # same than before but with a progress bar cat test_parallel.input | ./parallel.py -i /dev/stdin -v # run in parallel commands from test_parallel.input and store output # in output.log ./parallel.py -i test_parallel.input -o output.log # same than before but with a user defined output printer ./parallel.py -i test_parallel.input -o output.log -p post_proc_example ## real world usage example # 1) server side ./parallel.py -v -i many_commands.sh -o par_many_commands.log -s # 2) client side, on each machine you want to join the computation # replace SERVER_NAME by the machine name from where you launched # parallel.py using -s ./parallel.py -c SERVER_NAME # 3) be thrilled! ;)
instead of forcing users to provide either -c or -i currently
grouping of requests
ex: -n 10 will request 10 jobs each time
option is on the client side and
the default is 1 (current behavior)
If PAR was killed, there should be a file
on disk allowing to continue the job from where it was left
or an option to tell PAR to ignore the first N commands
in a commands file
as in "send workers quickly to work"
par_catapult.sh host_file
results should appear in the same order than the commands
were read in
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.