将数据加载到Synapse时发生Databricks错误:java.lang.IollegalArgumentExcep

Question

Exception encountered in Azure Synapse Analytics connector code

Databricks到Synapse的数据加载错误：

Caused by: java.lang.IllegalArgumentException: Column number mismatch

Answer 1

Databricks使用一个spark驱动程序连接到synapse，它检查azure synapse表(如果是现有表(和spark dataarme之间的列数、名称和列顺序。如果不匹配，它将抛出错误。

com.databricks.spark.sqldw.SqlDWConnectorException: Exception encountered in Azure Synapse Analytics connector code ..........
Caused by: java.lang.IllegalArgumentException: Column number mismatch