戈朗异步缓冲通道挂起



作为第一个项目,我决定编写一个简单的异步Webscaper。我的想法是让一组任务和一组工人"解决"任务。在编写程序时,我遇到了一个问题。

以下代码挂起:

package main
import (
    "fmt"
    "net/http"
    "time"
)
type Scraper struct {
    client http.Client
    timeout int
    tasks chan string
    results chan int
    ntasks int
}
func (s Scraper) Init(timeout int, workers int) {
    s.client = http.Client{
        Timeout: time.Second * time.Duration(timeout),
    }
    s.timeout = timeout
    s.ntasks = 0
    s.Dispatch(workers)
}
func (s Scraper) Wait() {
    for i := 0; i < s.ntasks; i++ {
        <-s.results
    }
}
func (s Scraper) Task(task string) {
    s.tasks <- task // hangs on this line
    s.ntasks++;
}
func (s Scraper) Dispatch(workers int) {
    s.tasks   = make(chan string, 100)
    s.results = make(chan int,    100)
    for i := 0; i < workers; i++ {
        go s.worker(i)
    }
}
func (s Scraper) worker(id int) {
    for task := range <-s.tasks {
        fmt.Println(task)
        s.results <- 0
    }
}
func main() {
    s := Scraper{}
    s.Init(10, 5)
    s.Task("Hello World")
    s.Wait()
}

虽然这不会:

func worker(id int, jobs <-chan int, results chan<- int) {
    for j := range jobs {
        fmt.Println("worker", id, "started  job", j)
        time.Sleep(time.Second)
        fmt.Println("worker", id, "finished job", j)
        results <- j * 2
    }
}
func main() {
    jobs    := make(chan int, 100)
    results := make(chan int, 100)
    for w := 1; w <= 3; w++ {
        go worker(w, jobs, results)
    }
    for j := 1; j <= 5; j++ {
        jobs <- j
    }
    close(jobs)
    for a := 1; a <= 5; a++ {
        <-results
    }
}

查看堆栈溢出,我看到未缓冲的通道挂起,但 make(chan 字符串,100(应该创建一个缓冲通道。

将所有接收器更改为指针,如下所示:

func (s *Scraper) Init(timeout int, workers int) // *Scraper not 'Scraper'

有关指针接收器的更多详细信息:https://tour.golang.org/methods/4

正如@JimB指出的 - 该范围也有一个错误,它应该是这样的:

func (s *Scraper) worker(id int) {
    // `range s.tasks` not `range <-s.tasks`
    for task := range s.tasks {
        fmt.Println(task)
        s.results <- 0
    }
}

带接收器和范围修复的游乐场:https://play.golang.org/p/RulKHHfnvJo