将字节[]转换为Golang Strange占用堆中的字符串



我发现奇怪的占用堆在将byte []转换为带有下面代码

的字符串
package main
import (
  "bytes"
  "fmt"
  "net/http"
  _ "net/http/pprof"
  "strings"
  "time"
)
var (
  c = make(chan int, 500000)
)
func main() {
  go func() {
    http.ListenAndServe(":8080", nil)
  }()
  f := func(ss []string) {
    fmt.Println(ss)
    time.Sleep(time.Millisecond)
    <-c
  }
  for {
    c <- 1
    bs := bytes.NewBufferString("A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,V,W,X,Y,Z").Bytes()
    fmt.Println(bs) // will raise memory leak after marked as comment???
    s := string(bs)
    ss := strings.Split(s, ",")
    go f(ss)
  }
}
  1. 没有 fmt.Println(bs)将逐渐耗尽内存。

  2. 使用fmt.Println(bs)工作正常。我不明白发生了什么?我与version go1.9.2 darwin/amd64

  3. 合作
态您正在使用500000并发goroutines,您只需要 limit(减少)并发goroutines ,例如:
c := make(chan int, runtime.NumCPU())

尝试此(并查看此编辑的结尾):

package main
import (
    "bytes"
    "fmt"
    "runtime"
    "strings"
    "time"
)
func main() {
    c := make(chan int, runtime.NumCPU())
    for {
        c <- 1
        bs := bytes.NewBufferString("A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,V,W,X,Y,Z").Bytes()
        s := string(bs)
        ss := strings.Split(s, ",")
        go func(ss []string) {
            fmt.Println(ss)
            time.Sleep(time.Millisecond)
            <-c
        }(ss)
    }
}

您的代码:

package main
import (
    "bytes"
    "fmt"
    "net/http"
    _ "net/http/pprof"
    "strings"
    "time"
)
var (
    c = make(chan int, 500000)
)
func main() {
    go func() {
        http.ListenAndServe(":8080", nil)
    }()
    f := func(ss []string) {
        fmt.Println(ss)
        time.Sleep(time.Millisecond)
        <-c
    }
    for {
        c <- 1
        bs := bytes.NewBufferString("A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,V,W,X,Y,Z").Bytes()
        // fmt.Println(bs) // will raise memory leak after marked as comment???
        s := string(bs)
        ss := strings.Split(s, ",")
        go f(ss)
    }
}

它在一段时间后达到稳态,甚至降低内存使用情况:

// Mem          CPU time:
// 5,464,208K 0:1:20
// 5,468,208K 0:2:20
// 5,469,608K 0:3:20
// 5,469,844K 0:4:20
// 5,469,844K 0:5:20
// 5,469,848K 0:6:20
// 5,469,848K 0:7:20 fixed
// 5,469,848K 0:8:20 fixed
// 5,469,616K 0:9:20 reduced

最新更新