具有(本地/多处理)分布式的高级图

Question

我应该如何在本地分布式设置中使用dask.highlevelgraph.HighLevelGraph。

顺序计算，例如

result = dask.get(some_high_level_graph, [some_targets])

工程。

import dask
from dask.highlevelgraph import HighLevelGraph as CG
# from dask import distributed as ddist
def inc(i):
    return i + 1
def add(a, b):
    return a + b
def mult(a, b):
    return a * b
wf = CG(
    layers = {
        1: {
            'inc': (inc, 1),
            'add': (add, 1, 'inc'),
        },
        2: {
            'mult': (mult, 3, 3)
        }
    },
    dependencies=[1, 2]
)
targets = ['add', 'mult']
r = dask.get(wf, targets)
print(r)
targets = ['mult']
r = dask.get(wf, targets)
print(r)

实际上，我想并行计算"添加"和"多

Answer 1

我能够自己解决问题。只需使用：

result = client.get(graph, targets)