Microsoft.DataTransfer.Common.Shared.HybridDeliveryException

Question

我有一个数据工厂，该数据工厂将来自Restful Web服务的数据复制到Azure数据仓库中。我已经测试并预览了所有连接和数据集。
我正在收到以下错误消息。

{
    "errorCode": "2200",  
    "message":   "ErrorCode=InvalidParameter,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The value of the property 'typeName' is invalid: 'Value cannot be null.rnParameter name: typeName'.,Source=,''Type=System.ArgumentNullException,Message=Value cannot be null.rnParameter name: typeName,Source=Microsoft.DataTransfer.Common,'",
    "failureType": "UserError",  
    "target": "ImportLegs"  
}

管道源

{
    "name": "Import Trip Data",
    "properties": {
        "activities": [
            {
                "name": "ImportLegs",
                "type": "Copy",
                "policy": {
                    "timeout": "7.00:00:00",
                    "retry": 0,
                    "retryIntervalInSeconds": 30,
                    "secureOutput": false,
                    "secureInput": false
                },
                "userProperties": [
                    {
                        "name": "Source",
                        "value": "flightleg?StartDate=01/01/2018&EndDate=02/01/2018"
                    },
                    {
                        "name": "Destination",
                        "value": "[Trip].[Leg]"
                    }
                ],
                "typeProperties": {
                    "source": {
                        "type": "RestSource",
                        "httpRequestTimeout": "00:01:40",
                        "requestInterval": "00.00:00:00.010"
                    },
                    "sink": {
                        "type": "SqlDWSink",
                        "allowPolyBase": false,
                        "writeBatchSize": 10000
                    },
                    "enableStaging": false,
                    "enableSkipIncompatibleRow": true,
                    "translator": {
                        "type": "TabularTranslator",
                        "mappings": [
                            {
                                "source": {
                                    "path": "id"
                                },
                                "sink": {
                                    "name": "Origin"
                                }
                            },
                            {
                                "source": {
                                    "path": "actualArrivalDateLocal"
                                },
                                "sink": {
                                    "name": "Destination"
                                }
                            },
                            {
                                "source": {
                                    "path": "actualArrivalDateUTC"
                                },
                                "sink": {
                                    "name": "FlightLogDistance"
                                }
                            },
                            {
                                "source": {
                                    "path": "actualBlockTime"
                                },
                                "sink": {
                                    "name": "FlightLogFlightTime"
                                }
                            },
                            {
                                "source": {
                                    "path": "actualDepartureDateLocal"
                                },
                                "sink": {
                                    "name": "Aircraft"
                                }
                            },
                            {
                                "source": {
                                    "path": "actualDepartureDateUTC"
                                },
                                "sink": {
                                    "name": "ScheduledDepartDate"
                                }
                            }
                        ]
                    }
                },
                "inputs": [
                    {
                        "referenceName": "FlightLeg",
                        "type": "DatasetReference"
                    }
                ],
                "outputs": [
                    {
                        "referenceName": "TripLegDW",
                        "type": "DatasetReference"
                    }
                ]
            }
        ]
    },
    "type": "Microsoft.DataFactory/factories/pipelines"
}

Answer 1

我也有同样的错误，经过一些研究，我找到了一些解决方案。发布以进一步帮助某人。

错误 -

{
"errorCode": "2200",
"message": "ErrorCode=UserErrorFailedS3FileReadOperation,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The operation on file part-00000-.csv.gz under directory test-bucket/abc_backfill/abc_visits is failed due to exception. ,Source=Microsoft.DataTransfer.ClientLibrary.MultipartBinaryConnector,''Type=Amazon.S3.AmazonS3Exception,Message=Error making request with Error Code Forbidden and Http Status Code Forbidden. No further error information was returned by the service.,Source=AWSSDK.Core,''Type=Amazon.Runtime.Internal.HttpErrorResponseException,Message=The remote server returned an error: (403) Forbidden.,Source=AWSSDK.Core,''Type=System.Net.WebException,Message=The remote server returned an error: (403) Forbidden.,Source=System,'",
"failureType": "UserError",
"target": "Copy data1",
"details": []

}

解决方案 - 我发现这是一些访问问题。即使在测试连接时，它也会取得成功，但是在执行管道时，它会失败上述消息。我发现，我访问了错误的DIR。如上所述，ABC_BACKFILL是root dir或共享abc_visits的dir，它给出了问题。

我发现我与abc_testbackfill有另一个共享dir，该dir指向相同的abc_visits。一旦我更改为数据集中的abc_testbackfill。它开始工作。所以我相信我在ABC_BACKFILL共享中没有访问权限，并且我遇到了错误。