Azure DF CopyFromBlob Failing



我正在尝试使用数据工厂将文件从Azure Blob复制到Azure Data Lake。 我一直遇到此错误,并且找不到有关参数"baseURI"映射到的内容的任何信息:

"errorCode": "2200",
"message": "ErrorCode=InvalidParameter,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The value of the property 'baseUri' is invalid: 'Value cannot be null.rnParameter name: baseUri'.,Source=,''Type=System.ArgumentNullException,Message=Value cannot be null.rnParameter name: baseUri,Source=Microsoft.DataTransfer.MsiStoreServiceClient,'",
"failureType": "UserError",
"target": "CopyFromBlob"

我正在使用带有json文件的Powershell。 我在这里缺少什么明显的东西?

Azure Data Lake Linked Service

{
    "name": "<redacted>",
    "properties": {
        "type": "AzureDataLakeStore",
        "typeProperties": {
            "dataLakeStoreUri": "<redacted>",
            "tenant": "<redacted>",
            "subscriptionId": "<redacted>",
            "resourceGroupName": "<redacted>"
        },
        "connectVia": {
            "referenceName": "<redacted>",
            "type": "IntegrationRuntimeReference"
        }
    }
}

Azure Blob Linked Service:

{
    "name": "<redacted>",
    "properties": {
        "type": "AzureStorage",
        "typeProperties": {
            "connectionString": {
                "type": "SecureString",
                "value": "DefaultEndpointsProtocol=https;AccountName=<redacted>;AccountKey=<redacted>"
            }
        },
        "connectVia": {
           "referenceName": "<redacted>",
           "type": "IntegrationRuntimeReference"
        }   
    }
}

数据湖数据集

{
    "name": "<redacted>",
    "properties": {
        "type": "AzureDataLakeStoreFile",
        "linkedServiceName":{
            "referenceName": "<redacted>",
            "type": "LinkedServiceReference"
        },
        "typeProperties": {
            "folderPath": "<redacted>"
        }
    }
}

Blob 数据集

{
    "name": "<redacted>",
    "properties": {
        "type": "AzureBlob",
        "linkedServiceName": {
            "referenceName": "<redacted>",
            "type": "LinkedServiceReference"
        },
        "typeProperties": {
            "folderPath": "<redacted>",
        }
    }
}

管道

{
"name": "<redacted>",
"properties": {
"activities":[
   {
        "name": "CopyFromBlob",
    "type": "Copy",
        "inputs": [
            {
                "referenceName": "<redacted>",
                "type": "DatasetReference"
            }
        ],
        "outputs": [
            {
                "referenceName": "<redacted>",
                "type": "DatasetReference"
            }
        ],
        "typeProperties": {
            "source": {
                "type": "BlobSource"
            },
            "sink": {
                "type": "AzureDataLakeStoreSink"
            }
        }
    }] 
}}

Powershell执行以下操作:

1. Create Data Factory
2. Create Azure Integration Runtime
3. Create Azure Data Lake Linked Service
4. Create Azure Blob Linked Service
5. Create Azure Blob Dataset
6. Create Azure Data Lake Dataset
7. Create pipeline
8. Invoke pipeline

检查 Azure 集成运行时 powershell 命令 - 是否定义了位置和类型?当我忘记为集成运行时定义位置时,我遇到了一个非常相似的错误(我的 null 参数是"字典"(。

希望这有帮助!

相关内容

  • 没有找到相关文章

最新更新