数据流作业挂起 在 beam 2.14 中找不到 ext4 文件系统



我的数据流作业挂起,我发现错误如下

2019-08-27 22:09:42.030 HKT
EXT4-fs (sdb): VFS: Can't find ext4 filesystem
Expand all | Collapse all {
insertId:  "s=be15be46dadc4bf6b53cb72a83412a3f;i=4b3;b=655c37b5c26541178d67bd3a584d0256;m=1b4b156;t=59119d2e5aba9;x=c15bd8bf26ae8753"  
jsonPayload: {…}  
labels: {…}  
logName:  "projects/projectname/logs/dataflow.googleapis.com%2Fsystem"  
receiveTimestamp:  "2019-08-27T14:09:49.701365316Z"  
resource: {…}  
severity:  "ERROR"  
timestamp:  "2019-08-27T14:09:42.030249Z"  
}

和其他警告

W 2019-08-27T14:09:16.285720Z [/usr/lib/tmpfiles.d/var.conf:12] Duplicate line for path "/var/run", ignoring. 
W 2019-08-27T14:09:16.299244Z Cannot set file attribute for '/var/log/journal', value=0x00800000, mask=0x00800000: Operation not supported 
W 2019-08-27T14:09:16.299660Z Cannot set file attribute for '/var/log/journal/32ffce3c053bcc2b3d6585166bd050d1', value=0x00800000, mask=0x00800000: Operation not supported 
W 2019-08-27T14:09:19.332660Z Could not load the device policy file. 
W 2019-08-27T14:09:22.434563Z [WARNING:persistent_integer.cc(96)] cannot open /var/lib/metrics/version.cycle for reading: No such file or directory 
W 2019-08-27T14:09:28.609260Z [CLOUDINIT] cc_write_files.py[WARNING]: Undecodable permissions None, assuming 420 
W 2019-08-27T14:09:28.610011Z [CLOUDINIT] cc_write_files.py[WARNING]: Undecodable permissions None, assuming 420 
W 2019-08-27T14:09:28.610490Z [CLOUDINIT] cc_write_files.py[WARNING]: Undecodable permissions None, assuming 420 

即使将光束升级到 2.15.0,这个问题仍然存在。

更新

当我在另一个 GCP 项目中运行相同的代码时,管道可以很好地工作......

看起来像GCE问题。您可能需要联系 Google Cloud 支持团队。

最新更新