为Cloud SQL API获取Google Cloud访问令牌,以便在Cloud Function中导入CSV



我正在寻找一个关于如何获得访问令牌的python 3示例,这样我就可以从GCS将csv文件从Google Cloud Function导入Cloud SQL。

它来自一个云函数,因此期望它运行的服务帐户或云SQL实例的服务帐户在获得访问权限时可以访问,但事实并非如此。

Response HTTP Response Body: {
"error": {
"code": 401,
"message": "Request is missing required authentication credential. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project.",
"errors": [
{
"message": "Login Required.",
"domain": "global",
"reason": "required",
"location": "Authorization",
"locationType": "header"
}
],
"status": "UNAUTHENTICATED"
}
}

下面是代码,我很好奇是否有人有一些关于我如何让它进行身份验证的示例代码。

response = requests.post(
url="https://www.googleapis.com/sql/v1beta4/projects/redacted-project/instances/redacted-instance/import",
headers={"Content-Type": "application/json; charset=utf-8"
},
data=json.dumps({
"importContext": {
"fileType": "CSV",
"csvImportOptions": {
"table": "service_data"
},
"uri": "gs://redacted-bucket/log/" + blob.name + "",
"database": "redacted-db"
}
})
)
print('Response HTTP Status Code: {status_code}'.format(status_code=response.status_code))
print('Response HTTP Response Body: {content}'.format(content=response.content))

您应该使用google-api-python-client为这个API构造一个服务,而不是试图直接发出请求。这将允许它选择云功能的默认服务帐户:

from googleapiclient.discovery import build
service = build('sql', 'v1beta4')
...

更多详细信息请点击此处:https://github.com/googleapis/google-api-python-client/blob/master/docs/start.md

1.从您的谷歌云功能中,通过查询元数据服务器获取auth令牌,假设您的云功能在默认服务帐户下运行,该帐户是应用程序引擎默认服务帐户,角色为Editor

import requests
import json
METADATA_URL = 'http://metadata.google.internal/computeMetadata/v1/'
METADATA_HEADERS = {'Metadata-Flavor': 'Google'}
SERVICE_ACCOUNT = 'default'

def import_table(request):
url = '{}instance/service-accounts/{}/token'.format(
METADATA_URL, SERVICE_ACCOUNT)
# Request an access token from the metadata server.
r = requests.get(url, headers=METADATA_HEADERS)
r.raise_for_status()
# Extract the access token from the response.
access_token = r.json()["access_token"]

body = json.dumps({'importContext': {'fileType': 'CSV',
'csvImportOptions': {'table': 'your_table'},
'uri': 'gs://temprun/your_dump_file',
'database': 'your_database'}})
response = requests.post(
url="https://www.googleapis.com/sql/v1beta4/projects/your_project/instances/your_sql_instance/import",
headers={"Content-Type": "application/json; charset=utf-8",
"Authorization": "Bearer {}".format(access_token)
},
data=body)    
return  str(response)

2.使用客户端库google-api-python-client:

def import_table(request):
from googleapiclient.discovery import build
service = build('sqladmin', 'v1beta4')
body = {'importContext': {'fileType': 'CSV',
'csvImportOptions': {'table': 'your_table'},
'uri': 'gs://temprun/your_dump_file',
'database': 'your_database'}}
service.instances().import_(project='your_project', instance='your_instance', body=body).execute()
return "Table was imported"

如果成功,则响应正文包含Operation的一个实例。

{'kind': 'sql#operation',
'targetLink': 'https://sqladmin.googleapis.com/sql/v1beta4/projects/your-project/instances/instance',
'status': 'PENDING',
'user': 'youraccount,
'insertTime': '2020-03-18T09:02:55.437Z',
'operationType': 'IMPORT',
'importContext': {'uri': 'gs://yourbucket/dumpfile',
'database': 'yourdatabase',
'kind': 'sql#importContext',
'fileType': 'CSV',
'csvImportOptions': {'table': 'sql-table}},
'name': 'cdcd53d4-96fe-41cf-aee4-12cf6ec6394e',
'targetId': 'instance_name',
'selfLink': 'https://sqladmin.googleapis.com/sql/v1beta4/projects/project/operations/cdcd53d4-96fe-41cf-aee4-12cf6ec6394e',
'targetProject': 'your-project'}

在Google Cloud Functions中,您可以通过查询元数据服务器来获取auth令牌。

不过,还有一个更简单的选择:使用云SQL客户端库。这将自动为您获取身份验证令牌。

这两个选项都将通过PROJECT_ID@appspot.gserviceaccount.com服务帐户。如果你正在进行跨项目调用等,你可能需要授予该帐户权限。

相关内容

  • 没有找到相关文章

最新更新