Comments (10)
It's possible to make pymesos a standalone package.
However mesos.interface package seems to be little help for pymesos, as pymesos needs message_pb2.py imported, which contains internal interfaces and structs and is not released within mesos.interface package.
So I'm not sure whether releasing pymesos is beneficial. Any comment is welcome.
from dpark.
And sorry for the late reply, it was Chinese Mid-Autumn Festival here. :)
from dpark.
Actually, I found what you said about messages_pb2.py while attempting to make pymesos an standalone package. Still, there are some benefits like having more people helping to keep it uptodate with mesos releases.
I worked on making an standalone pymesos package (for internal use but ready to be released), then I updated it for mesos 0.20.0 and implemented reconcileTasks()
method to SchedulerDriver interface. I am very happy to contribute my work back to you but ideally in the form of a standalone package so we don't have to maintain two versions. thanks.
from dpark.
OK, that's fine. I'm waiting for the releasing.
from dpark.
There you go https://github.com/dangra/pymesos.
from dpark.
I'm leaving for vacations tomorrow, feel free to move the repo to whatever place you think it is best. Also I think pymesos is a good name and it is available on pypi at the moment. thanks!
from dpark.
back, any chance you looked at the pymesos repo?
from dpark.
looks great! I'v made a fork as douban/pymesos. maybe we should submit this package to pypi when it's ready. And I'm working on a new version of DPark to use this pymesos package instead of the hard-coded one, and making DPark compatible with Mesos 0.20. The new version of DPark still need more tests.
from dpark.
We've made a repo https://github.com/douban/pymesos & uploaded the package to https://pypi.python.org/pypi/pymesos/0.0.1.
from dpark.
great!
from dpark.
Related Issues (20)
- 运行 demo时候, 会在text search example 卡住
- 安装报错 HOT 2
- Couldn't download the mesos.interface HOT 3
- from dpark import DparkContext ERROR HOT 2
- pymesos 0.1.6 VS mesosphere 1.1.0, 取不到 slave id HOT 1
- 建议增加hdfs支持 HOT 1
- DeprecationWarning: Call to deprecated function or method decompress (use lz4.block.decompress instead) HOT 2
- 通过textFile创建rdd时,如何给每一行文本添加一个行号? HOT 2
- 能不能加入环境说明 HOT 2
- Bump and release a new version
- pypy 启动报错 HOT 2
- dpark支持mysql数据源嘛? HOT 1
- lz4 error HOT 1
- ERROR HOT 1
- lz4wrapper.py没有更新 HOT 4
- [INFO] [dpark.context] no web server created as No module named gevent.pywsgi HOT 11
- 运行dpark出现奇怪现象 HOT 8
- 使用dpark时遇到的问题 HOT 1
- 如何在windows环境下调试 HOT 1
- Increase the usage of augmented assignment statements
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dpark.