Comments (1)
If you ctrl+C the program in standalone mode, you can see these:
step:Input0
output : d0
shard:0 time:2.038281735s processed 2779
step:Map1
input : d0
shard:0 time:2.038321665s processed 2779
output : d1
shard:0 time:2.038380948s processed 2779
step:Map2
input : d1
shard:0 time:2.038388886s processed 2779
output : d2
shard:0 time:2.038408013s processed 2779
step:LocalSort3
input : d2
shard:0 time:2.03841651s processed 2779
output : d3
shard:0 time:2.038403271s processed 0
step:LocalReduceByKey4
input : d3
shard:0 time:2.038411775s processed 0
output : d4
shard:0 time:2.038419295s processed 0
step:MergeSorted5
input : d4
shard:0 time:2.038427534s processed 0
output : d5
shard:0 time:2.038420435s processed 0
step:LocalReduceByKey6
input : d5
shard:0 time:2.038428171s processed 0
output : d6
shard:0 time:2.038496247s processed 0
This shows the "step:LocalSort3" is not started.
Now you can do a "kill -3" for the program:
goroutine 23 [chan receive]:
github.com/chrislusf/glow/flow.(*Dataset).Map.func1(0xc8200a23c0)
/Users/chrislu/dev/gopath/src/github.com/chrislusf/glow/flow/dataset_map.go:27 +0x9b
github.com/chrislusf/glow/flow.(*Task).RunTask(0xc8200a23c0)
/Users/chrislu/dev/gopath/src/github.com/chrislusf/glow/flow/step_task.go:33 +0x2d
github.com/chrislusf/glow/flow.(*Step).RunStep.func1(0xc820067540, 0x0, 0xc8200a23c0)
/Users/chrislu/dev/gopath/src/github.com/chrislusf/glow/flow/step.go:22 +0x48
created by github.com/chrislusf/glow/flow.(*Step).RunStep
/Users/chrislu/dev/gopath/src/github.com/chrislusf/glow/flow/step.go:23 +0xd3
It shows the "step:Map2" is not finished. What it is waiting for?
It shows the "chIn" channel is not closed.
from glow.
Related Issues (20)
- Fold operation HOT 3
- Add unit tests for moderately complex APIs across the code base HOT 8
- Fix the timing out flakiness revealed in dataset_map_test.go HOT 2
- document failure/retry modes in distributed use HOT 1
- any ideas to add Lua(LuaJIT)? HOT 14
- Consider reduce the number of Travis CI builds HOT 3
- any plan for hive like execution engine? HOT 2
- Is there a means of teeing the flow? HOT 3
- All the work is done by only 1 node HOT 2
- Read size invalid argument - expected data input? HOT 7
- Issues at start_local_glow_cluster.sh HOT 2
- Doing partial reduceByKey in Flow created in func init() HOT 3
- How to make it working for multiple split logs HOT 2
- Glow support a time window like the Flink?
- glow使用与部署方法怎么处理? HOT 3
- Has it been used in the commercial production environment so far?
- glow run block when read big file data to mysql HOT 2
- Glow support for elastic search
- feature requiest: type i to enter editor mode
- update instalation instructions since go get is not longer surported HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from glow.