Comments (6)
birdsarah
commented on August 13, 2024
No problems with pip.
from dask-yarn.
jcrist
commented on August 13, 2024
I'm unable to reproduce with a clean environment. Perhaps you have other things in your environment already causing a conflict, and conda's version conflict reporting heuristic is failing here? What version of Python?
$ conda install -c conda-forge dask-yarn
Collecting package metadata: ...working... done
Solving environment: ...working... done
## Package Plan ##
environment location: /home/testuser/miniconda
added / updated specs:
- dask-yarn
The following packages will be downloaded:
package | build
---------------------------|-----------------
bokeh-1.1.0 | py37_0 6.3 MB conda-forge
c-ares-1.15.0 | h14c3975_1001 98 KB conda-forge
ca-certificates-2019.3.9 | hecc5488_0 146 KB conda-forge
certifi-2019.3.9 | py37_0 149 KB conda-forge
click-7.0 | py_0 61 KB conda-forge
cloudpickle-0.8.1 | py_0 17 KB conda-forge
conda-4.6.14 | py37_0 2.1 MB conda-forge
cytoolz-0.9.0.1 |py37h14c3975_1001 414 KB conda-forge
dask-1.2.0 | py_0 4 KB conda-forge
dask-core-1.2.0 | py_0 530 KB conda-forge
dask-yarn-0.6.0 | py37_0 38 KB conda-forge
distributed-1.27.0 | py37_0 838 KB conda-forge
freetype-2.10.0 | he983fc9_0 885 KB conda-forge
grpcio-1.16.1 | py37hf8bcb03_1 1.0 MB
heapdict-1.0.0 | py37_1000 7 KB conda-forge
jinja2-2.10.1 | py_0 91 KB conda-forge
jpeg-9c | h14c3975_1001 251 KB conda-forge
libblas-3.8.0 | 6_openblas 6 KB conda-forge
libcblas-3.8.0 | 6_openblas 6 KB conda-forge
libgfortran-3.0.0 | 1 281 KB conda-forge
liblapack-3.8.0 | 6_openblas 6 KB conda-forge
libpng-1.6.37 | hed695b0_0 343 KB conda-forge
libprotobuf-3.7.1 | h8b12597_0 4.6 MB conda-forge
libtiff-4.0.10 | h648cc4a_1001 592 KB conda-forge
locket-0.2.0 | py_2 6 KB conda-forge
markupsafe-1.1.1 | py37h14c3975_0 26 KB conda-forge
msgpack-python-0.6.1 | py37h6bb024c_0 88 KB conda-forge
numpy-1.16.3 | py37he5ce36f_0 4.3 MB conda-forge
olefile-0.46 | py_0 31 KB conda-forge
openblas-0.3.5 | ha44fe06_0 13.7 MB conda-forge
openssl-1.1.1b | h14c3975_1 4.0 MB conda-forge
packaging-19.0 | py_0 23 KB conda-forge
pandas-0.24.2 | py37hf484d3e_0 11.1 MB conda-forge
partd-0.3.9 | py_0 16 KB conda-forge
pillow-5.3.0 |py37h00a061d_1000 595 KB conda-forge
protobuf-3.7.1 | py37he1b5a44_0 651 KB conda-forge
psutil-5.6.1 | py37h14c3975_0 316 KB conda-forge
pyparsing-2.4.0 | py_0 55 KB conda-forge
python-dateutil-2.8.0 | py_0 219 KB conda-forge
pytz-2019.1 | py_0 227 KB conda-forge
pyyaml-5.1 | py37h14c3975_0 183 KB conda-forge
skein-0.7.0 | py_0 6.7 MB conda-forge
sortedcontainers-2.1.0 | py_0 25 KB conda-forge
tblib-1.3.2 | py_1 11 KB conda-forge
toolz-0.9.0 | py_1 42 KB conda-forge
tornado-6.0.2 | py37h516909a_0 635 KB conda-forge
zict-0.1.4 | py_0 10 KB conda-forge
------------------------------------------------------------
Total: 61.4 MB
<trimmed for brevity>
from dask-yarn.
birdsarah
commented on August 13, 2024
python 3.6, i tried with a clean environment, just python 3.6, and got the same error. I'm on EMR 0.11.1 if that's relevant.
from dask-yarn.
jcrist
commented on August 13, 2024
The command
$ conda create -n demo python=3.6 dask-yarn -c conda-forge
works fine for me on linux. Perhaps an old version of conda?
from dask-yarn.
jcrist
commented on August 13, 2024
Any updates here @birdsarah?
from dask-yarn.
jcrist
commented on August 13, 2024
Closing as stale, if this problem continues feel free to reopen.
from dask-yarn.
Related Issues (20)
- AWS EMR bootstrap script fails HOT 5
- Conda environment does not activate HOT 1
- Dask Scheduler host/port Not Written to Skein Key-Value Storage When YARN Application Restarts HOT 5
- Move default branch from "master" -> "main" HOT 1
- YarnCluster.shutdown() Won't Work on EMR, results in `concurrent.futures._base.CancelledError` HOT 1
- Verify that Read the Docs is building after master -> main HOT 7
- YarnCluster hangs HOT 11
- wait_for_workers got stuck when to create cluster but application failed on yarn HOT 3
- dask-yarn job fails with dumps_msgpack ImportError HOT 3
- register workers of scheduler are less than workers in dashborad HOT 1
- can't upload files HOT 2
- EMR 6.3.0 Bootstrap Action BOOTSTRAP_FAILURE : Python 3.9 support? HOT 3
- Application Failure When Submitting Dask-Yarn Model Inferencing Job Remotely
- FileNotFoundError: [Errno 2] No such file or directory: 'yarn' HOT 3
- Jupyter Notebook Cell Hangs after submitting job to remote EMR cluster
- distributed 2022.3.0 no more compatible with dask-yarn because of missing "status" attribute in YarnCluster HOT 7
- YarnCluster() does not initialize but runs indefinetly HOT 3
- AttributeError while running dask on amazon EMR. HOT 3
- .skein.sh: line 2: environment/bin/python: No such file or directory HOT 4
- Bootstrapping for 40min, when use the script. HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dask-yarn.