Comments (1)
- We can create a single channel on each peer for point to point messages, and send all in-coming point-to-point messages to that channel. We also need to register a handler to handle those messages.
the implementation might look like:
diff --git a/srcs/go/rchannel/router.go b/srcs/go/rchannel/router.go
index cf12f72..8901e58 100644
--- a/srcs/go/rchannel/router.go
+++ b/srcs/go/rchannel/router.go
@@ -114,6 +114,16 @@ func (r *Router) stream(conn net.Conn, remote plan.NetAddr) (int, error) {
return i, err
}
r.monitor.Ingress(int64(msg.Length), remote)
- r.bufferPool.require(remote.WithName(name)) <- msg
+ if isCollective(msg) {
+ r.bufferPool.require(remote.WithName(name)) <- msg
+ } else {
+ p2pCh <- msg
+ // TODO: handler for p2pCh
+ }
}
}
+
+func isCollective(msg *Message) bool {
+ // TODO: determine msg type
+ return true
+}
-
The Ako operator can register a callback function on the message handler.
-
Now we are assuming the peers are numbered from 0 to n - 1, so knowing
n
should be sufficient.
from kungfu.
Related Issues (20)
- bert demo question HOT 4
- panic error HOT 3
- When using the config-server, if you call allgather api, it will block.
- After remove the worker from the cluster, it is better to set the rank id to -1. HOT 3
- Elastic hook can't support training from checkpoint.
- Support real global batch normalisation HOT 2
- Inconsistency detected by ld.so
- failed to establish connection to the newly runner HOT 5
- the kungfu-job is hang when it scale down HOT 2
- kungfu job is hang in a inconsistent version when i scale down/up mutiple times HOT 14
- Performance drops when TensorFlow experimental XLA JIT is enabled. HOT 6
- [doc] request parameters doc when the -init-version=-1 HOT 5
- Support for share-memory channels? HOT 1
- use a dedicated thread for NCCL operations
- Access to Adaptive Batch Size Policy
- Is Windows supported?
- Error from pytoch demo HOT 1
- code loss HOT 2
- A question about Horovod central coordinator in the paper of KungFu HOT 2
- With PairAveragingOptimizer, is it possible that two workers in different iterations average their models? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kungfu.