无法使用apachebeam-python将json写入Pubsub主题



我正试图从pubsub中读取一个主题,并进行一些清理/转移,并将最终结果写入另一个pubsub主题。然而,我最终还是犯了以下错误。请引导我。

代码:

Ingest = ( p
| 'Read from Topic' >> beam.io.ReadFromPubSub(topic=known_args.topic).with_output_types(bytes)
| 'Parse'   >> beam.Map(parse_json)
| 'Cleanup' >> beam.Map(cleanup)
| 'write to pubsub' | beam.io.WriteToPubSub("projects/test/topics/cdp_aa_food" , with_attributes=False)
)

我得到的错误如下:

raise TypeError("Expected a PTransform object, got %s" % transform)
TypeError: Expected a PTransform object, got write to pubsub

不确定我做错了什么。。

Ingest = ( p
| 'Read from Topic' >> beam.io.ReadFromPubSub(topic=known_args.topic).with_output_types(bytes)
| 'Parse'   >> beam.Map(parse_json)
| 'Cleanup' >> beam.Map(cleanup)
| 'write to pubsub' >> beam.io.WriteToPubSub("projects/test/topics/cdp_aa_food" , with_attributes=False)
)

管道中有一个打字错误,write to pubsub步骤需要>>而不是|

最新更新