Comments (7)
mrocklin
commented on August 13, 2024
I think that this would be resolved by
dask/dask-yarn#95 , but I'm not sure. It would
require some experimentation. cc @jcrist
…On Wed, Aug 7, 2019 at 11:52 AM Ben Schreck ***@***.***> wrote:
I'm not sure how hard it would be to allow Dask Yarn clusters. I tried it,
and it fails because there is no asynchronous keyword in
YarnCluster.__init__. I'm not sure if launching the cluster
asynchronously would be necessary for this functionality.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
<#77?email_source=notifications&email_token=AACKZTAQTT5XCZONAPYZ57DQDMKVHA5CNFSM4IKDJJSKYY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4HD7AQPA>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/AACKZTANM6XDI4ORRFAHJB3QDMKVHANCNFSM4IKDJJSA>
.
from dask-labextension.
ian-r-rose
commented on August 13, 2024
While the async story settles, you might want to try using this branch, which removes the need for async cluster starting.
from dask-labextension.
bschreck
commented on August 13, 2024
@mrocklin That looks like it would probably resolve the issue.
In the meantime I think I can easily create my own branch. @ian-r-rose that doesn't quite work because there's no cluster.scheduler attribute for the YarnCluster.
from dask-labextension.
bschreck
commented on August 13, 2024
This seems to be working: https://github.com/bschreck/dask-labextension
from dask-labextension.
AlJohri
commented on August 13, 2024
hi, just wanted to check in on this issue- what is required to support Dask Yarn with the lab extension? I mostly just want to see the dask dashboard within jupyter lab, I can start the dask YarnCluster manually. Does this already work?
from dask-labextension.
mrocklin
commented on August 13, 2024
I recommend that people ask these questions at github.com/dask/dask-yarn . The maintainer of Dask-Yarn sometimes doesn't check issues here.
from dask-labextension.
jcrist
commented on August 13, 2024
Apologies for the late response here. As of dask-yarn 0.8.0, asynchronous support works fine. Tested and verified it works with dask-labextension. This can be closed.
from dask-labextension.
Related Issues (20)
- Dashboard doesn't show when scheduler does not listen on localhost HOT 1
- Update branding
- Open Dashboard programmatically HOT 3
- Specify default address to look for scheduler HOT 13
- Dashboard shows cluster of different user HOT 1
- No visibility (black background) with JupyterLab in Dark theme HOT 3
- Can't connect to local cluster using local IP and port HOT 1
- 5.3.0 does not create a schemas/dask-labextension/plugin.json file on install HOT 11
- Default layout HOT 4
- Need to press the new "Launch in JupyterLab" button twice HOT 1
- Help connecting to existing KubeCluster using the build-in Discovery Mechanism HOT 2
- Using +NEW freezes Jupyterlab completely HOT 3
- JLab 4.0 side-effect: Class 'RenderedCommon' incorrectly implements interface 'IRenderer'. HOT 12
- Logos no longer working well HOT 4
- Conflicting dependencies with jupyterlab=4.0.2 HOT 3
- Inject client code adds an empty cell. HOT 3
- Release HOT 3
- Button Launch Dashboard in Jupyterlab not available HOT 1
- JLab 4-compatible release HOT 5
- Dashboard does not display graphs with bokeh = 3.3.0 HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dask-labextension.