Comments (12)
mrocklin
commented on September 17, 2024
cc'ing conda/dask experts @jakirkham @mariusvniekerk in case they have any insight
from dask-examples.
quasiben
commented on September 17, 2024
Can you get the conda version being used in the binder example ? If it's less than 4.9 we should probably upgrade it
from dask-examples.
nils-braun
commented on September 17, 2024
Thanks for your comment @quasiben. I just checked: The currently running image includes conda in version 4.8.2. If 4.9 will really help, that could be an issue.
Where is the conda version specified? Isn't this part of the mybinder installation process where we do not have a large number of configuration possibilities?
from dask-examples.
quasiben
commented on September 17, 2024
No that's probably not it then. I launched an instanced on binder and things pleasantly worked with mamba. i would suggest either using mamba or pip, or, why not add directly to the env.yml file ? Any reason not to do this @mrocklin ?
from dask-examples.
nils-braun
commented on September 17, 2024
Yes, image size. The package I would like to add (dask-sql) adds another approx 400 MB, which is quite a lot.
mamba is definitely a possibility, but as it should also showcase on how to install the package and mamba is not as known as conda, I am a bit hesitant. But sure, if it works I am fine with it.
from dask-examples.
jsignell
commented on September 17, 2024
I'm wondering if this is a channel issue. It seems that both nodejs==14 and numpy==1.18 are in the env: https://github.com/dask/dask-examples/blob/master/binder/environment.yml, but they are coming from conda-forge. Does your conda install work if you specify the channel?
from dask-examples.
quasiben
commented on September 17, 2024
@jsignell I tried your suggestion but that also doesn't work. Also it does work with Mamba:
jovyan@jupyter-nils-2dbraun-2ddask-2dexamples-2dajduqqec:~$ mamba install -c conda-forge dask-sql
__ __ __ __
/ \ / \ / \ / \
/ \/ \/ \/ \
███████████████/ /██/ /██/ /██/ /████████████████████████
/ / \ / \ / \ / \ \____
/ / \_/ \_/ \_/ \ o \__,
/ _/ \_____/ `
|/
███╗ ███╗ █████╗ ███╗ ███╗██████╗ █████╗
████╗ ████║██╔══██╗████╗ ████║██╔══██╗██╔══██╗
██╔████╔██║███████║██╔████╔██║██████╔╝███████║
██║╚██╔╝██║██╔══██║██║╚██╔╝██║██╔══██╗██╔══██║
██║ ╚═╝ ██║██║ ██║██║ ╚═╝ ██║██████╔╝██║ ██║
╚═╝ ╚═╝╚═╝ ╚═╝╚═╝ ╚═╝╚═════╝ ╚═╝ ╚═╝
mamba (0.6.1) supported by @QuantStack
GitHub: https://github.com/mamba-org/mamba
Twitter: https://twitter.com/QuantStack
█████████████████████████████████████████████████████████████
conda-forge/linux-64 Using cache
conda-forge/noarch Using cache
pkgs/main/noarch [====================] (00m:00s) No change
pkgs/r/linux-64 [====================] (00m:00s) No change
pkgs/r/noarch [====================] (00m:00s) No change
pkgs/main/linux-64 [====================] (00m:00s) No change
Looking for: ['dask-sql']
Transaction
Prefix: /srv/conda/envs/notebook
Updating specs:
- dask-sql
Package Version Build Channel Size
─────────────────────────────────────────────────────────────────────────────────
Install:
─────────────────────────────────────────────────────────────────────────────────
aiofiles 0.6.0 pyhd8ed1ab_0 conda-forge/noarch 14 KB
alsa-lib 1.2.3 h516909a_0 conda-forge/linux-64 560 KB
aniso8601 7.0.0 py_0 conda-forge/noarch 31 KB
dask-sql 0.1.2 py_0 conda-forge/noarch 18 MB
fastapi 0.61.1 py_0 conda-forge/noarch 40 KB
graphene 2.1.8 py_0 conda-forge/noarch 39 KB
graphql-core 2.3.2 pyh9f0ad1d_0 conda-forge/noarch 89 KB
graphql-relay 2.0.1 py_0 conda-forge/noarch 18 KB
h11 0.11.0 pyh9f0ad1d_0 conda-forge/noarch 44 KB
httptools 0.1.1 py38h1e0a361_1 conda-forge/linux-64 102 KB
itsdangerous 1.1.0 py_0 conda-forge/noarch 16 KB
jpype1 1.1.2 py38hbf85e49_0 conda-forge/linux-64 452 KB
openjdk 11.0.8 hacce0ff_0 conda-forge/linux-64 173 MB
promise 2.3 py38h32f6830_2 conda-forge/linux-64 35 KB
pydantic 1.7.2 py38h25fe258_0 conda-forge/linux-64 2 MB
python-dotenv 0.15.0 pyhd8ed1ab_0 conda-forge/noarch 20 KB
python-multipart 0.0.5 py_0 conda-forge/noarch 28 KB
rx 1.6.1 py_0 conda-forge/noarch 74 KB
starlette 0.13.6 py_0 conda-forge/noarch 4 KB
starlette-base 0.13.6 py_0 conda-forge/noarch 45 KB
ujson 4.0.1 py38h950e882_1 conda-forge/linux-64 48 KB
uvicorn 0.12.2 py38h32f6830_0 conda-forge/linux-64 67 KB
uvloop 0.14.0 py38h1e0a361_2 conda-forge/linux-64 1 MB
watchgod 0.6 py_0 conda-forge/noarch 13 KB
websockets 8.1 py38h1e0a361_2 conda-forge/linux-64 90 KB
xorg-fixesproto 5.0 h14c3975_1002 conda-forge/linux-64 8 KB
xorg-inputproto 2.3.2 h14c3975_1002 conda-forge/linux-64 18 KB
xorg-libxfixes 5.0.3 h516909a_1004 conda-forge/linux-64 17 KB
xorg-libxi 1.7.10 h516909a_0 conda-forge/linux-64 45 KB
xorg-libxtst 1.2.3 h516909a_1002 conda-forge/linux-64 31 KB
xorg-recordproto 1.14.2 h516909a_1002 conda-forge/linux-64 7 KB
Change:
─────────────────────────────────────────────────────────────────────────────────
certifi 2020.6.20 py38h32f6830_0 installed
certifi 2020.6.20 py38h924ce5b_2 conda-forge/linux-64 151 KB
Upgrade:
─────────────────────────────────────────────────────────────────────────────────
ca-certificates 2020.6.20 hecda079_0 installed
ca-certificates 2020.10.14 0 pkgs/main/linux-64 Cached
Summary:
Install: 31 packages
Change: 1 packages
Upgrade: 1 packages
Total download: 197 MB
─────────────────────────────────────────────────────────────────────────────────
Confirm changes: [Y/n]
I also tried with:
conda install -c conda-forge dask-sql --no-update-deps
And received the same PackagesNotFoundError error
from dask-examples.
jsignell
commented on September 17, 2024
Yeah I tried it too :( I feel like there must be some conda settings somewhere, but I can't find them
from dask-examples.
jsignell
commented on September 17, 2024
I feel like there must be some conda settings somewhere, but I can't find them
Nah that's not it either. I just checked them and conda-forge is in the default channels list, so adding the channel makes no difference.
from dask-examples.
jacobtomlinson
commented on September 17, 2024
It's been a while since anyone was here but I tried this again today and can confirm that things are still the same. Conda fails but mamba succeeds to install.
from dask-examples.
saulshanabrook
commented on September 17, 2024
Same for me... So odd!
from dask-examples.
saulshanabrook
commented on September 17, 2024
Locally it fails for me with:
Collecting package metadata (repodata.json): done
Solving environment: failed
ResolvePackageNotFound:
- bokeh=2.1.1
- nodejs=14
It does seem to be building in the github actions with the environment.yml, but it does fail for me locally on mac with an arm chip.
I believe my issue is that these packages, nodejs=14 and bokeh=2.1.1 have no builds on conda forge for an arm mac.
If I upgrade them both to a version that does have those builds, then it can create it locally. I will create a PR that at least updates these two pins minimally, so I can install it locally.
from dask-examples.
Related Issues (20)
- Placement of interactive dashboard in JupyterLab HOT 2
- Move default branch from "master" -> "main"
- json-data-on-the-web CI check timing out HOT 2
- Binder badge links give 404 errors from survey result notebooks HOT 4
- Remove binder banner in favour of theme banner
- Dashboard needs to be set up every time HOT 1
- Update dependencies and ensure all notebooks are working HOT 5
- Running the Bag example several times consecutively results in a `JSONDecodeError`
- Automatically clear notebook output HOT 1
- XGBoost example notebook uses deprecated dask-xgboost HOT 2
- Website missing `dask-sphinx-theme` font HOT 2
- Create an Example of Using TPOT Using Dataset that DOESN'T Fit in Memory HOT 1
- Large scale XGBoost example with HyperParameter Optimization HOT 21
- Binder build fails with conda conflict
- Attribute error in imshow of an image processing result HOT 2
- ML notebook points to ML tutorial lesson that was removed
- XGboost example outdated and broken doc links
- Calling len(ddf) within the 01_datraframe.ipynb tutorial fails due to mismatched dtypes.
- Dask slides hyperlink led to "Page not found" error HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dask-examples.