grpool's Introduction

grpool - 修改版

Lightweight Goroutine pool

Clients can submit jobs. Dispatcher takes job, and sends it to first available worker. When worker is done with processing job, will be returned back to worker pool.

Number of workers and Job queue size is configurable.

Docs

https://godoc.org/github.com/ivpusic/grpool

Installation

go get github.com/wanghongfei/grpool

添加Future机制

pool := NewPool(2, 10)

f := pool.SubmitFuture(func() interface{} {
    time.Sleep(time.Second * 3)
    return "ok"
})

// block直到任务完成
fmt.Println(<-f.ResultChan)

使用注意事项

如果想用pool.WaitAll()来等待所有任务结束，就必须在提交任务之前调用pool.WaitCount(N), 否则WaitAll()会立刻返回起不到效果
任务的执行没有超时控制，如果一个任务永远跑不完，就会永远占用一个routine。
如果不需要获取任务的返回值，推荐使用无返回值的pool.Submit()方法提交任务，降低开销

Example with waiting jobs to finish

package main

import (
  "fmt"
  "runtime"

  "github.com/ivpusic/grpool"
)

func main() {
  // number of workers, and size of job queue
  pool := grpool.NewPool(100, 50)
  defer pool.Release()

  // how many jobs we should wait
  pool.WaitCount(10)

  // submit one or more jobs to pool
  for i := 0; i < 10; i++ {
    count := i

    pool.Submit(func() interface{} {
		defer pool.JobDone()

		time.Sleep(time.Second * 1)

		// 返回值会被忽略
		return nil
	})
  }

  // wait until we call JobDone for all jobs
  pool.WaitAll()
}