使用Python和XML.etree.ElementTree解析XML时遇到一些挑战

Question

<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<feed xml:base="https://share.corp.com/sites/CPIBudget/_vti_bin/ListData.svc/" xmlns:d="http://schemas.microsoft.com/ado/2007/08/dataservices" xmlns:m="http://schemas.microsoft.com/ado/2007/08/dataservices/metadata" xmlns="http://www.w3.org/2005/Atom">
<title type="text">Tbl_Projects_Tableau</title>
<id>https://share.corp.com/sites/CPIBudget/_vti_bin/ListData.svc/Tbl_Projects_Tableau/</id>
<updated>2018-07-25T21:27:59Z</updated>
<link rel="self" title="Tbl_Projects_Tableau" href="Tbl_Projects_Tableau" />
<entry m:etag="W/&quot;8&quot;">
<id>https://share.corp.com/sites/CPIBudget/_vti_bin/ListData.svc/Tbl_Projects_Tableau(1)</id>
<title type="text"></title>
<updated>2018-06-14T17:15:27Z</updated>
<author>
<name />
</author>
<link rel="edit" title="Tbl_Projects_TableauItem" href="Tbl_Projects_Tableau(1)" />
<link rel="http://schemas.microsoft.com/ado/2007/08/dataservices/related/FBN_ID" type="application/atom+xml;type=entry" title="FBN_ID" href="Tbl_Projects_Tableau(1)/FBN_ID" />
<link rel="http://schemas.microsoft.com/ado/2007/08/dataservices/related/CreatedBy" type="application/atom+xml;type=entry" title="CreatedBy" href="Tbl_Projects_Tableau(1)/CreatedBy" />
<link rel="http://schemas.microsoft.com/ado/2007/08/dataservices/related/ModifiedBy" type="application/atom+xml;type=entry" title="ModifiedBy" href="Tbl_Projects_Tableau(1)/ModifiedBy" />
<category term="Microsoft.SharePoint.DataService.Tbl_Projects_TableauItem" scheme="http://schemas.microsoft.com/ado/2007/08/dataservices/scheme" />
<content type="application/xml">
<m:properties>
<d:FBN_IDId m:type="Edm.Int32">6</d:FBN_IDId>
<d:Title m:null="true" />
<d:PROJECT_NAME>Project Swoop</d:PROJECT_NAME>
<d:Cluster>ABC</d:Cluster>
<d:PROJECT_SITE>ABC9</d:PROJECT_SITE>
<d:PROJECT_ORIGINALAMT m:type="Edm.Double">500000</d:PROJECT_ORIGINALAMT>
<d:PROJECT_ORG>Nookie</d:PROJECT_ORG>
<d:PROJECT_GROUP>Smooth</d:PROJECT_GROUP>
<d:c__OldID m:type="Edm.Double">1</d:c__OldID>
<d:ContentTypeID>0x0100FD279BEBCF3C4F45BB75D6147D315C09</d:ContentTypeID>
<d:Id m:type="Edm.Int32">1</d:Id>
<d:ContentType>Item</d:ContentType>
<d:Modified m:type="Edm.DateTime">2018-06-14T17:15:27</d:Modified>
<d:Created m:type="Edm.DateTime">2018-06-14T16:58:50</d:Created>
<d:CreatedById m:type="Edm.Int32">2</d:CreatedById>
<d:ModifiedById m:type="Edm.Int32">2</d:ModifiedById>
<d:Owshiddenversion m:type="Edm.Int32">8</d:Owshiddenversion>
<d:Version>1.0</d:Version>
<d:Path>/sites/SmoothBudget/Lists/Projects_Tableau1</d:Path>
</m:properties>
</content>
</entry>
</feed>

以下是我试图解析为CSV的XML示例。

这是我到目前为止的代码：

import config
import csv
import pymysql
import requests
import xml.etree.ElementTree as ET
from requests_ntlm import HttpNtlmAuth
ssoUsername = config.username
ssoPassword = config.password
f = open(path+csvFile,'w',newline='')
csvwriter = csv.writer(f)
column_headers = ['FBN','Project_Name','Cluster','Site','OP2_USD','Type','Group']
csvwriter.writerow(column_headers)
rows = []
r2 = requests.get(project_url, auth=HttpNtlmAuth('ANT\'+ssoUsername,ssoPassword), verify=False)
projectData = r2.content
etree2 = ET.fromstring(projectData)
#print(etree2.findall('.****'))
for element in etree2.findall(".****") :
print(element.find('{http://schemas.microsoft.com/ado/2007/08/dataservices}FBN_IDId'))
fbnKey2 = element.find('{http://schemas.microsoft.com/ado/2007/08/dataservices}FBN_IDId')
FBN = fbnMap.get(fbnKey2)

因此，在这一点上，我无法获得{http://schemas.microsoft.com/ado/2007/08/dataservices}FBN_IDId元素。无论我尝试什么xPath，它总是给我NoneType没有属性文本错误。

以下是打印(etree2.findall('.***((的结果

[<Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}ContentTypeID' at 0x000001C4B7F31BD8>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Id' at 0x000001C4B7F31C28>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}ContentType' at 0x000001C4B7F31C78>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Modified' at 0x000001C4B7F31CC8>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Created' at 0x000001C4B7F31D18>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}CreatedById' at 0x000001C4B7F31D68>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}ModifiedById' at 0x000001C4B7F31DB8>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Owshiddenversion' at 0x000001C4B7F31E08>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Version' at 0x000001C4B7F31E58>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Path' at 0x000001C4B7F31EA8>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}FBN_IDId' at 0x000001C4B7F3ABD8>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Title' at 0x000001C4B7F3AB88>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}PROJECT_NAME' at 0x000001C4B7F3AB38>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Cluster' at 0x000001C4B7F3AA98>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}PROJECT_SITE' at 0x000001C4B7F3AA48>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}PROJECT_ORIGINALAMT' at 0x000001C4B7F3A9F8>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}PROJECT_ORG' at 0x000001C4B7F3A908>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}PROJECT_GROUP' at 0x000001C4B7F3A868>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}c__OldID' at 0x000001C4B7F3A8B8>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}ContentTypeID' at 0x000001C4B7F3A778>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Id' at 0x000001C4B7F3A728>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}ContentType' at 0x000001C4B7F3A6D8>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Modified' at 0x000001C4B7F3A138>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Created' at 0x000001C4B7F3A048>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}CreatedById' at 0x000001C4B7F3A638>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}ModifiedById' at 0x000001C4B7F3A5E8>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Owshiddenversion' at 0x000001C4B7F3A548>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Version' at 0x000001C4B7F3A598>, <Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}Path' at 0x000001C4B7F3A4F8>]

看起来我应该能够获得FBNIId，但我能做的最好的事情就是获得

None
<Element '{http://schemas.microsoft.com/ado/2007/08/dataservices}FBN_IDId' at 0x000001C4B7F3ABD8>

并且这导致none类型错误。我唯一能让它发挥作用的时候是做：

for element in etree2.findall(".//{http://schemas.microsoft.com/ado/2007/08/dataservices}FBN_IDId") :
fbnKey2 = element.text
FBN = fbnMap.get(fbnKey2)

但如果我这样做，那么我必须为我需要的每个元素都这样做，然后找出如何将它们组合成一行，然后循环添加所有行，这似乎是错误的。

建议？

Answer 1

也许你可以使用完整的路径：

/feed/entry/content/m:properties/d:FBN_IDId

或：

/feed/entry/content/{http://schemas.microsoft.com/ado/2007/08/dataservices/metadata}properties/{http://schemas.microsoft.com/ado/2007/08/dataservices}FBN_IDId

Answer 2

在循环中

for element in etree2.findall(".****") :

您正在向下四级迭代所有元素。对于每个这样的元素，您可以在其子元素中搜索那些名为FBN_IDId的元素。这将发现任何向下五级的元素。

然而，没有任何这样的元素。它们只存在于四层之下。

也许您想迭代所有元素三个级别，并查找这些元素的子元素，命名为FBN_IDId？这可以通过删除循环中的一个*来完成：

for element in etree2.findall(".***") :

然而，该循环也将找到空的<name />元素。

也许写会更好

for element in etree2.findall(".//{http://schemas.microsoft.com/ado/2007/08/dataservices/metadata}properties") :

其循环通过任何深度的所有CCD_ 5元素。