无法打开FastText以便从bucket加载



我下载了fasttext模型lid.176.bin。如果我在文件夹中使用模型在本地运行代码,一切都很好。但我需要在GC中运行它,所以,我将模型上传到bucket中,并将模型的路径从local更改为gs bucket,得到了一个错误:ValueError: gs://models/fasttext-model/lid.176.bin cannot be opened for loading!如何使用bucket中的模型?

path_to_pretrained_model = 'gs://models/fasttext-model/lid.176.bin'
fasttext_model = fasttext.load_model(path_to_pretrained_model)

谷歌文档中的这个功能帮助我解决问题

from google.cloud import storage

def download_blob(bucket_name, source_blob_name, destination_file_name):
"""Downloads a blob from the bucket."""
# bucket_name = "your-bucket-name"
# source_blob_name = "storage-object-name"
# destination_file_name = "local/path/to/file"
storage_client = storage.Client()
bucket = storage_client.bucket(bucket_name)
# Construct a client side representation of a blob.
# Note `Bucket.blob` differs from `Bucket.get_blob` as it doesn't retrieve
# any content from Google Cloud Storage. As we don't need additional data,
# using `Bucket.blob` is preferred here.
blob = bucket.blob(source_blob_name)
blob.download_to_filename(destination_file_name)
print(
"Blob {} downloaded to {}.".format(
source_blob_name, destination_file_name
)
)

相关内容

  • 没有找到相关文章