我的弹性搜索为kibana启用了cognito身份验证。这一切都如预期的那样顺利。
在我的python脚本中,我通过在http_auth((中提供用户名/密码来连接到elasticsearch,同时创建连接对象。但是,当我尝试检查索引是否存在时,是否出现身份验证错误?有人能帮忙吗。这是您模拟的代码示例。
from __future__ import print_function
import json
import time
import urllib
import re
import sys
import requests
import base64
import time
from elasticsearch import Elasticsearch
from datetime import datetime
esEndpoint = ""
uname
pwd
indexName = 'index_1'
mappings_rds = {
"settings": {
"number_of_shards": 2,
"number_of_replicas": 1
},
"mappings": {
"properties" : {
"tableName": {
"type": "keyword"
},
"tableRows": {
"type": "integer"
},
"updatedTime": {
"type": "date",
"format":"date_optional_time||yyyy-MM-dd'T'HH:mm:ss"
},
"created_timestamp":{
"type": "date",
"format":"date_optional_time||yyyy-MM-dd'T'HH:mm:ss"
}
}
}
}
esClient = Elasticsearch([esEndPoint],http_auth=(uname,pwd))
try:
res = esClient.indices.exists(indexName)
print(res)
if res is False:
r = esClient.indices.create(indexName, body=mapping_rds, ignore=400)
return 1
except Exception as E:
print("Unable to Create Index {0}".format(indexName))
感谢大家的评论。我就此与AWS支持团队进行了通话。问题被发现是用户名&我使用过的密码。我使用的是使用AWS Cognito创建的用户凭据。AWS支持团队证实,上述凭据仅用于Kibana访问,不能用于从databricks/python脚本连接到Elasticsearch。
此处提供更多信息:https://docs.aws.amazon.com/elasticsearch-service/latest/developerguide/es-request-signing.html
一旦我生成了访问/密钥,并从python脚本中使用它,我就可以连接到elasticsearch来创建索引。
共享样本代码以供将来参考:
session=boto3.session.Session(aws_access_key_id=akey, aws_secret_access_key=skey, region_name=region)
credentials = session.get_credentials()
awsauth = AWS4Auth(credentials.access_key, credentials.secret_key, region, service, session_token=credentials.token)
print(credentials.access_key, credentials.secret_key, credentials.token)
es = Elasticsearch(
hosts = [{'host': esEndpoint, 'port': 443}],
http_auth = awsauth,
use_ssl = True,
verify_certs = True,
connection_class = RequestsHttpConnection
)
感谢