小贝子编程

listOfDict到RDF在python中的转换，目标是Apache Jena Fuseki



要从python在Apache Jena中存储一些数据，我希望进行从Dicts列表到RDF的通用转换，并可能返回查询。

对于Dict-to-RDF部分的列表；插入判决列表"；(见下文(并用"；testListOfDictInsert"；(见下文(。结果如下，当使用ApacheJenaFuseki服务器进行尝试时，会导致400:错误请求。

对于简单的字符串类型，需要修复什么？对于其他原始Python类型，可能需要修复什么才能使其工作

还请在以下位置找到源代码：

  • https://github.com/WolfgangFahl/DgraphAndWeaviateTest/blob/master/dg/jena.py
  • https://github.com/WolfgangFahl/DgraphAndWeaviateTest/blob/master/tests/testJena.py
@prefix foaf: <http://xmlns.com/foaf/0.1/>
INSERT DATA {
foaf:Person/Elizabeth+Alexandra+Mary+Windsor foaf:Person#name "Elizabeth Alexandra Mary Windsor".
foaf:Person/Elizabeth+Alexandra+Mary+Windsor foaf:Person#born "1926-04-21".
foaf:Person/Elizabeth+Alexandra+Mary+Windsor foaf:Person#wikidataurl "https://www.wikidata.org/wiki/Q9682".
foaf:Person/George+of+Cambridge foaf:Person#name "George of Cambridge".
foaf:Person/George+of+Cambridge foaf:Person#born "2013-07-22".
foaf:Person/George+of+Cambridge foaf:Person#wikidataurl "https://www.wikidata.org/wiki/Q1359041".
foaf:Person/Harry+Duke+of+Sussex foaf:Person#name "Harry Duke of Sussex".
foaf:Person/Harry+Duke+of+Sussex foaf:Person#born "1984-09-15".
foaf:Person/Harry+Duke+of+Sussex foaf:Person#wikidataurl "https://www.wikidata.org/wiki/Q152316".
}

testListOfDictInsert

def testListOfDictInsert(self):
'''
test inserting a list of Dicts using FOAF example
https://en.wikipedia.org/wiki/FOAF_(ontology)
'''
listofDicts=[
{'name': 'Elizabeth Alexandra Mary Windsor', 'born': '1926-04-21', 'age': 94, 'ofAge': True , 'wikidataurl': 'https://www.wikidata.org/wiki/Q9682' },
{'name': 'George of Cambridge',              'born': '2013-07-22', 'age':  7, 'ofAge': False, 'wikidataurl': 'https://www.wikidata.org/wiki/Q1359041'},
{'name': 'Harry Duke of Sussex',             'born': '1984-09-15', 'age': 36, 'ofAge': True , 'wikidataurl': 'https://www.wikidata.org/wiki/Q152316'}
]
jena=self.getJena(mode='update',debug=True)
jena.insertListOfDicts(listofDicts,'foaf:Person','name','@prefix foaf: <http://xmlns.com/foaf/0.1/>')

插入判决列表

def insertListOfDicts(self,listOfDicts,entityType,primaryKey,prefixes):
'''
insert the given list of dicts mapping datatypes according to
https://www.w3.org/TR/xmlschema-2/#built-in-datatypes

mapped from 
https://docs.python.org/3/library/stdtypes.html

compare to
https://www.w3.org/2001/sw/rdb2rdf/directGraph/
http://www.bobdc.com/blog/json2rdf/
https://www.w3.org/TR/json-ld11-api/#data-round-tripping
https://stackoverflow.com/questions/29030231/json-to-rdf-xml-file-in-python
'''
errors=[]
insertCommand='%snINSERT DATA {n' % prefixes
for index,record in enumerate(listOfDicts):
if not primaryKey in record:
errors.append["missing primary key %s in record %d",index]
else:    
primaryValue=record[primaryKey]
encodedPrimaryValue=urllib.parse.quote_plus(primaryValue)
tSubject="%s/%s" %(entityType,encodedPrimaryValue)
for keyValue in record.items():
key,value=keyValue
valueType=type(value)
if self.debug:
print("%s(%s)=%s" % (key,valueType,value))
tPredicate="%s#%s" % (entityType,key)
tObject=value    
if valueType == str:   
insertCommand+='  %s %s "%s".n' % (tSubject,tPredicate,tObject)
insertCommand+="n}"
if self.debug:
print (insertCommand)
self.insert(insertCommand)
return errors

+是HTTP Form编码中用于空间的特殊字符，但它只能在application/x-www-form-urlencoded中使用。

对于URI，请使用%20或决定使用诸如_之类的替换字符来表示空格，因为它看起来有点像空格。

在所有这些情况下，URI中都没有空格字符——有+、%20(三个字符(或_。它是编码，而不是转义机制。

以下代码至少可以工作，并且具有正确的"往返"；行为从Dicts列表中插入的数据可以使用相应的quer进行检索。请评论更多改进或添加更好的答案。

如果您总是想获得typedLiterals，那么现在可以在Jena包装器类的构造函数中指定它。

在打字文字模式下，单元测试插入是：

类型

  • 整数
  • 十进制

用于适当的"；往返"；行为

PREFIX foafo: <http://foafo.bitplan.com/foafo/0.1/>
INSERT DATA {
foafo:Person_ElizabethAlexandraMaryWindsor foafo:Person_name "Elizabeth Alexandra Mary Windsor".
foafo:Person_ElizabethAlexandraMaryWindsor foafo:Person_born "1926-04-21"^^<http://www.w3.org/2001/XMLSchema#date>.
foafo:Person_ElizabethAlexandraMaryWindsor foafo:Person_numberInLine "0"^^<http://www.w3.org/2001/XMLSchema#integer>.
foafo:Person_ElizabethAlexandraMaryWindsor foafo:Person_wikidataurl "https://www.wikidata.org/wiki/Q9682".
foafo:Person_ElizabethAlexandraMaryWindsor foafo:Person_age "94.32637220476806"^^<http://www.w3.org/2001/XMLSchema#decimal>.
foafo:Person_ElizabethAlexandraMaryWindsor foafo:Person_ofAge True.
foafo:Person_CharlesPrinceofWales foafo:Person_name "Charles, Prince of Wales".
foafo:Person_CharlesPrinceofWales foafo:Person_born "1948-11-14"^^<http://www.w3.org/2001/XMLSchema#date>.
foafo:Person_CharlesPrinceofWales foafo:Person_numberInLine "1"^^<http://www.w3.org/2001/XMLSchema#integer>.
foafo:Person_CharlesPrinceofWales foafo:Person_wikidataurl "https://www.wikidata.org/wiki/Q43274".
foafo:Person_CharlesPrinceofWales foafo:Person_age "71.7578047461618"^^<http://www.w3.org/2001/XMLSchema#decimal>.
foafo:Person_CharlesPrinceofWales foafo:Person_ofAge True.
foafo:Person_GeorgeofCambridge foafo:Person_name "George of Cambridge".
foafo:Person_GeorgeofCambridge foafo:Person_born "2013-07-22"^^<http://www.w3.org/2001/XMLSchema#date>.
foafo:Person_GeorgeofCambridge foafo:Person_numberInLine "3"^^<http://www.w3.org/2001/XMLSchema#integer>.
foafo:Person_GeorgeofCambridge foafo:Person_wikidataurl "https://www.wikidata.org/wiki/Q1359041".
foafo:Person_GeorgeofCambridge foafo:Person_age "7.072013799051315"^^<http://www.w3.org/2001/XMLSchema#decimal>.
foafo:Person_GeorgeofCambridge foafo:Person_ofAge False.
foafo:Person_HarryDukeofSussex foafo:Person_name "Harry Duke of Sussex".
foafo:Person_HarryDukeofSussex foafo:Person_born "1984-09-15"^^<http://www.w3.org/2001/XMLSchema#date>.
foafo:Person_HarryDukeofSussex foafo:Person_numberInLine "5"^^<http://www.w3.org/2001/XMLSchema#integer>.
foafo:Person_HarryDukeofSussex foafo:Person_wikidataurl "https://www.wikidata.org/wiki/Q152316".
foafo:Person_HarryDukeofSussex foafo:Person_age "35.92133993168922"^^<http://www.w3.org/2001/XMLSchema#decimal>.
foafo:Person_HarryDukeofSussex foafo:Person_ofAge True.
}

当文字模式为关闭类型时，文字仅用于日期：

PREFIX foafo: <http://foafo.bitplan.com/foafo/0.1/>
INSERT DATA {
foafo:Person_ElizabethAlexandraMaryWindsor foafo:Person_name "Elizabeth Alexandra Mary Windsor".
foafo:Person_ElizabethAlexandraMaryWindsor foafo:Person_born "1926-04-21"^^<http://www.w3.org/2001/XMLSchema#date>.
foafo:Person_ElizabethAlexandraMaryWindsor foafo:Person_numberInLine 0.
foafo:Person_ElizabethAlexandraMaryWindsor foafo:Person_wikidataurl "https://www.wikidata.org/wiki/Q9682".
foafo:Person_ElizabethAlexandraMaryWindsor foafo:Person_age 94.32637220476806.
foafo:Person_ElizabethAlexandraMaryWindsor foafo:Person_ofAge True.
foafo:Person_CharlesPrinceofWales foafo:Person_name "Charles, Prince of Wales".
foafo:Person_CharlesPrinceofWales foafo:Person_born "1948-11-14"^^<http://www.w3.org/2001/XMLSchema#date>.
foafo:Person_CharlesPrinceofWales foafo:Person_numberInLine 1.
foafo:Person_CharlesPrinceofWales foafo:Person_wikidataurl "https://www.wikidata.org/wiki/Q43274".
foafo:Person_CharlesPrinceofWales foafo:Person_age 71.7578047461618.
foafo:Person_CharlesPrinceofWales foafo:Person_ofAge True.
foafo:Person_GeorgeofCambridge foafo:Person_name "George of Cambridge".
foafo:Person_GeorgeofCambridge foafo:Person_born "2013-07-22"^^<http://www.w3.org/2001/XMLSchema#date>.
foafo:Person_GeorgeofCambridge foafo:Person_numberInLine 3.
foafo:Person_GeorgeofCambridge foafo:Person_wikidataurl "https://www.wikidata.org/wiki/Q1359041".
foafo:Person_GeorgeofCambridge foafo:Person_age 7.072013799051315.
foafo:Person_GeorgeofCambridge foafo:Person_ofAge False.
foafo:Person_HarryDukeofSussex foafo:Person_name "Harry Duke of Sussex".
foafo:Person_HarryDukeofSussex foafo:Person_born "1984-09-15"^^<http://www.w3.org/2001/XMLSchema#date>.
foafo:Person_HarryDukeofSussex foafo:Person_numberInLine 5.
foafo:Person_HarryDukeofSussex foafo:Person_wikidataurl "https://www.wikidata.org/wiki/Q152316".
foafo:Person_HarryDukeofSussex foafo:Person_age 35.92133993168922.
foafo:Person_HarryDukeofSussex foafo:Person_ofAge True.
}

testListOfDictInsert

def testListOfDictInsert(self):
'''
test inserting a list of Dicts and retrieving the values again
using a person based example
instead of
https://en.wikipedia.org/wiki/FOAF_(ontology)

we use an object oriented derivate of FOAF with a focus on datatypes
'''
listofDicts=[
{'name': 'Elizabeth Alexandra Mary Windsor', 'born': self.dob('1926-04-21'), 'numberInLine': 0, 'wikidataurl': 'https://www.wikidata.org/wiki/Q9682' },
{'name': 'Charles, Prince of Wales',         'born': self.dob('1948-11-14'), 'numberInLine': 1, 'wikidataurl': 'https://www.wikidata.org/wiki/Q43274' },
{'name': 'George of Cambridge',              'born': self.dob('2013-07-22'), 'numberInLine': 3, 'wikidataurl': 'https://www.wikidata.org/wiki/Q1359041'},
{'name': 'Harry Duke of Sussex',             'born': self.dob('1984-09-15'), 'numberInLine': 5, 'wikidataurl': 'https://www.wikidata.org/wiki/Q152316'}
]
today=date.today()
for person in listofDicts:
born=person['born']
age=(today - born).days / 365.2425
person['age']=age
person['ofAge']=age>=18
typedLiteralModes=[True,False]
entityType='foafo:Person'
primaryKey='name'
prefixes='PREFIX foafo: <http://foafo.bitplan.com/foafo/0.1/>'
for typedLiteralMode in typedLiteralModes:
jena=self.getJena(mode='update',typedLiterals=typedLiteralMode,debug=True)
errors=jena.insertListOfDicts(listofDicts,entityType,primaryKey,prefixes)
self.checkErrors(errors)

jena=self.getJena(mode="query")    
queryString = """
PREFIX foafo: <http://foafo.bitplan.com/foafo/0.1/>
SELECT ?name ?born ?numberInLine ?wikidataurl ?ofAge ?age WHERE { 
?person foafo:Person_name ?name.
?person foafo:Person_born ?born.
?person foafo:Person_numberInLine ?numberInLine.
?person foafo:Person_wikidataurl ?wikidataurl.
?person foafo:Person_ofAge ?ofAge.
?person foafo:Person_age ?age. 
}"""
personResults=jena.query(queryString)
self.assertEqual(len(listofDicts),len(personResults))
personList=jena.asListOfDicts(personResults)   
for index,person in enumerate(personList):
print("%d: %s" %(index,person))
# check the correct round-trip behavior
self.assertEqual(listofDicts,personList)

insertListOfDicts

def insertListOfDicts(self,listOfDicts,entityType,primaryKey,prefixes):
'''
insert the given list of dicts mapping datatypes according to
https://www.w3.org/TR/xmlschema-2/#built-in-datatypes

mapped from 
https://docs.python.org/3/library/stdtypes.html

compare to
https://www.w3.org/2001/sw/rdb2rdf/directGraph/
http://www.bobdc.com/blog/json2rdf/
https://www.w3.org/TR/json-ld11-api/#data-round-tripping
https://stackoverflow.com/questions/29030231/json-to-rdf-xml-file-in-python
'''
errors=[]
insertCommand='%snINSERT DATA {n' % prefixes
for index,record in enumerate(listOfDicts):
if not primaryKey in record:
errors.append["missing primary key %s in record %d",index]
else:    
primaryValue=record[primaryKey]
encodedPrimaryValue=self.getLocalName(primaryValue)
tSubject="%s_%s" %(entityType,encodedPrimaryValue)
for keyValue in record.items():
key,value=keyValue
valueType=type(value)
if self.debug:
print("%s(%s)=%s" % (key,valueType,value))
tPredicate="%s_%s" % (entityType,key)
tObject=value    
if valueType == str:   
tObject='"%s"' % value
elif valueType==int:
if self.typedLiterals:
tObject='"%d"^^<http://www.w3.org/2001/XMLSchema#integer>' %value
pass
elif valueType==float:
if self.typedLiterals:
tObject='"%s"^^<http://www.w3.org/2001/XMLSchema#decimal>' %value
pass
elif valueType==bool:
pass
elif valueType==datetime.date:
#if self.typedLiterals:
tObject='"%s"^^<http://www.w3.org/2001/XMLSchema#date>' %value
pass
else:
errors.append("can't handle type %s in record %d" % (valueType,index))
tObject=None
if tObject is not None:    
insertCommand+='  %s %s %s.n' % (tSubject,tPredicate,tObject)
insertCommand+="n}"
if self.debug:
print (insertCommand)
self.insert(insertCommand)
return errors

相关内容

最新更新


热门标签：

javascript python java c# php android html jquery c++ css ios sql mysql arrays asp.net json python-3.x ruby-on-rails .net sql-server django objective-c excel regex ruby linux ajax iphone xml vba spring asp.net-mvc database wordpress string postgresql wpf windows xcode bash git oracle list vb.net multithreading eclipse algorithm macos powershell visual-studio image forms numpy scala function api selenium