触发DAG从谷歌云功能用Python编写的



我在谷歌云平台上使用Python创建的云函数运行有问题。我正在尝试使用云功能触发DAG,并遵循官方文档中指定的所有规则来执行此操作。我一直得到这个错误代码。

EDT
gcs-dag-trigger-function
68hsnlvog0g6
Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.9/site-packages/flask/app.py", line 2073, in wsgi_app
response = self.full_dispatch_request()
File "/layers/google.python.pip/pip/lib/python3.9/site-packages/flask/app.py", line 1518, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/layers/google.python.pip/pip/lib/python3.9/site-packages/flask/app.py", line 1516, in full_dispatch_request
rv = self.dispatch_request()
File "/layers/google.python.pip/pip/lib/python3.9/site-packages/flask/app.py", line 1502, in dispatch_request
return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args)
File "/layers/google.python.pip/pip/lib/python3.9/site-packages/functions_framework/__init__.py", line 171, in view_func
function(data, context)
File "/workspace/main.py", line 48, in trigger_dag
make_iap_request(
File "/workspace/main.py", line 87, in make_iap_request
raise Exception(
Exception: Bad response from application: 404 / {'Date': 'Fri, 15 Jul 2022 16:25:22 GMT', 'Content-Type': 'text/html; charset=utf-8', 'Vary': 'Accept-Encoding', 'Server': 'gunicorn', 'X-Robots-Tag': 'noindex, nofollow', 'Set-Cookie': 'session=d8fb37f6-bd2d-4a2c-8abc-e528eadc9ac3.hUuadQnCRiJzbuufKObZIMtsTL8; Expires=Sun, 14-Aug-2022 16:25:22 GMT; HttpOnly; Path=/; SameSite=Lax', 'Content-Encoding': 'gzip', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000,h3-Q050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"', 'Transfer-Encoding': 'chunked'} / 'nn<!DOCTYPE html>n<html lang="en">n  <head>n    <title>Airflow 404</title>n    <link rel="icon" type="image/png" href="/static/pin_32.png">n  </head>n  <body>n    <div style="font-family: verdana; text-align: center; margin-top: 200px;">n      <img src="/static/pin_100.png" width="50px" alt="pin-logo" />n      <h1>Airflow 404</h1>n      <p>Page cannot be found.</p>n      <a href="/">Return to the main page</a>n      <p>3405c1ef5ce7</p>n    </div>n  </body>n</html>'
有谁能帮我一下吗?

@AnjelaB事实证明,因为我使用的是气流2(这是在Cloud Composer中启动的版本),你必须在你的云函数中使用代码,USE_EXPERIMENTAL_API=False,因为你现在使用的是稳定的API。其次,您的普通服务帐户不能工作,因为它的字符太长(即64)&您只能使用具有有限字符数的SA。解决方法是使用在此链接

中找到的文档手动添加SA作为气流用户。

最新更新