python子进程运行带有多个输入参数的bash脚本的错误处理与使用硬编码输入成功运行bash脚本的错误处理

我有一个Rest API执行curl命令在bash脚本检索报纸信息从一个国家图书馆网站如下。我可以用两种不同的方式运行这个bash脚本:

$ bash sof.sh # input arguments are hardcoded! WORKS OK!
$ python file.py # input arguments are passed from a dictionary! ERROR!

这是sof.sh文件:

#!/bin/bash
: '
################## 1) Running via Bash Script & hardcoding input arguments ##################
myQUERY="Rusanen"
myORDERBY="DATE_DESC"
myFORMATS='["NEWSPAPER"]'
myFUZZY="false"
myPubPlace='["Iisalmi", "Kuopio"]'
myLANG='["FIN"]'
################## 1) Running via Bash Script & hardcoding input arguments ##################
# Result: OK! a json file with retreived expected information
'
#: '
################## 2) Running from python script with input arguments ##################
for ARGUMENT in "$@"
do
#echo "$ARGUMENT"
KEY=$(echo $ARGUMENT | cut -f1 -d=)
KEY_LENGTH=${#KEY}
VALUE="${ARGUMENT:$KEY_LENGTH+1}"
export "$KEY"="$VALUE"
done
echo $# "ARGS:" $*
################## 2) Running from python script with input arguments ##################
# Result: Error!!
#'
out_file_name="newspaper_info_query_${myQUERY// /_}.json"
echo ">> Running $0 | Searching for QUERY: $myQUERY | Saving in $out_file_name"
curl 'https://digi.kansalliskirjasto.fi/rest/binding-search/search/binding?offset=0&count=10000' 
-H 'Accept: application/json, text/plain, */*' 
-H 'Cache-Control: no-cache' 
-H 'Connection: keep-alive' 
-H 'Content-Type: application/json' 
-H 'Pragma: no-cache' 
--compressed 
--output $out_file_name 
-d @- <<EOF
{   "query":"$myQUERY",
"languages":$myLANG,
"formats":$myFORMATS,
"orderBy":"$myORDERBY",
"fuzzy":$myFUZZY,
"publicationPlaces": $myPubPlace
}
EOF

在bash脚本中使用手动硬编码的输入参数运行$ bash sof.sh可以很好地处理预期的行为，也就是说，它返回一个包含预期信息的json文件。

然而，为了自动化我的代码，我需要使用$ python file.py和subprocess运行这个bash脚本，如下所示:

def rest_api_sof(params={}):    
params = {'query':            ["Rusanen"], 
'publicationPlace': ["Iisalmi", "Kuopio"], 
'lang':             ["FIN"], 
'orderBy':          ["DATE_DESC"], 
'formats':          ["NEWSPAPER"], 
}
print(f"REST API: {params}")
subprocess.call(['bash',
'sof.sh',
f'myFORMATS={params.get("formats", "")}',
f'myQUERY={",".join(params.get("query"))}',
f'myORDERBY={",".join(params.get("orderBy", ""))}',
f'myLANG={params.get("lang", "")}',
f'myPubPlace={params.get("publicationPlace", "")}',
])
if __name__ == '__main__':
rest_api_sof()

要复制并看到json文件中的错误，请注释1) Running via Bash Script & hard coding input arguments并相应取消注释2) Running from python script with input arguments并运行$ python file.py。

下面是我的json文件运行$ python file.py后的错误:

<!doctype html>
<html lang="fi">
<head prefix="og: http://ogp.me/ns# fb: http://ogp.me/ns/fb# article: http://ogp.me/ns/article#">
<title>Digitaaliset aineistot - Kansalliskirjasto</title>
<meta name="viewport" content="width=device-width, initial-scale=1.0, maximum-scale=1.0, user-scalable=no">
<meta name="robots" content="index, follow"/>
<meta name="copyright" content="Kansalliskirjasto. Kaikki oikeudet pidätetään."/>
<link rel="shortcut icon" href="/favicon.ico" type="image/x-icon">
<base href="/">
<meta name="google-site-verification" content="fLK4q3SMlbeGTQl-tN32ENsBoaAaTlRd8sRbmTxlSBU" />
<meta name="msvalidate.01" content="7EDEBF53A1C81ABECE44A7A666D94950" />
<link rel="preconnect" href="https://fonts.googleapis.com">
<link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>
<link href="https://fonts.googleapis.com/css2?family=DM+Serif+Display&family=Open+Sans:ital,wght@0,300;0,400;0,600;0,700;1,400&display=swap" rel="stylesheet">
<script>
(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','//www.google-analytics.com/analytics.js','ga');
ga('create', 'UA-10360577-3', 'auto');
</script>
<!-- Global site tag (gtag.js) - Google Analytics -->
<script async src="https://www.googletagmanager.com/gtag/js?id=G-KF8NK1STFH"></script>
<script>
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
// see google-analytics.service
</script>
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];

(function() {
var u = "https://tilasto.lib.helsinki.fi/";
_paq.push(['setTrackerUrl', u + 'matomo.php']);
_paq.push(['setSiteId', '17']);
var d = document, g = d.createElement('script'), s = d.getElementsByTagName('script')[0];
g.async = true;
g.src = u + 'matomo.js';
s.parentNode.insertBefore(g, s);
}
)();
</script>
<noscript><p><img src="https://tilasto.lib.helsinki.fi/matomo.php?idsite=17&amp;rec=1" style="border:0;" alt=""/></p></noscript>
<!-- End Matomo Code --><style type="text/css">[ng-cloak] { display: none !important; }</style>
<script>
window.errorHandlerUrl = "/rest/js-error-handler";
window.commonOptions = {"localLoginEnabled":true,"localRegistrationEnabled":false,"marcOverlayEnabled":true,"opendataEnabled":true,"overrideHeader":"","hakaEnabled":true,"includeExternalResources":true,"legalDepositWorkstation":false,"jiraCollectorEnabled":true,"buildNumber":"8201672f226078f2cefbe8a0025dc03f5d98c25f","searchMaxResults":10000,"showExperimentalSearchFeatures":true,"bindingSearchMaxResults":1000,"excelDownloadEnabled":true,"giosgEnabled":true};
</script>
<style type="text/css">.external-resource-alt { display: none !important; }</style>
</head>
<body class="digiweb">
<noscript>
<h3>Sovellus vaatii JavaScriptin.</h3>
<p>Ole hyvä ja laita selaimesi JavaScript päälle, jos haluat käyttää palvelua.</p>
<h3>Aktivera Javascript.</h3>
<p>För att kunna använda våra webbaserade system behöver du ha Javascript aktiverat.</p>
<h3>This application requires JavaScript.</h3>
<p>Please turn on JavaScript in order to use the application.</p>
</noscript><app-digiweb></app-digiweb>
<div id="kk-server-error" style="display: none;">
<h1 align="center">Järjestelmässä tapahtui virhe.</h1></div>
<div id="kk-server-page" style="display: none;">
</div>
<script type="text/javascript">
window.language = "fi";
window.renderId = 1673541833124;
window.facebookAppId = "465149013631512"
window.reCaptchaSiteKey = "6Lf7xuASAAAAANNu9xcDirXyzjebiH4pPpkKVCKq";
</script>
<script src="/assets/runtime-es2015.f1ac93cb35b9635f0f7e.js" type="module"></script>
<script src="/assets/runtime-es5.f1ac93cb35b9635f0f7e.js" nomodule></script>
<script src="/assets/polyfills-es2015.8db02cde19c51f542c72.js" type="module"></script>
<script src="/assets/polyfills-es5.2273af7ef2cf66cdc0de.js" nomodule></script>
<script src="/assets/styles-es2015.a539381f703344410705.js" type="module"></script>
<script src="/assets/styles-es5.a539381f703344410705.js" nomodule></script>
<script src="" type="module"></script>
<script src="" type="module"></script>
<script src="" nomodule></script>
<script src="/assets/main-es2015.b5796f606e925a9d947d.js" type="module"></script>
<script src="/assets/main-es5.b5796f606e925a9d947d.js" nomodule></script>
</body>
</html>

为了调试它，我用一个非常简单的Bash脚本替换了sof.sh:

#!/bin/sh
printf "'%s'n" "$@"

输出如下:

'myFORMATS=['NEWSPAPER']'
'myQUERY=Rusanen'
'myORDERBY=DATE_DESC'
'myLANG=['FIN']'
'myPubPlace=['Iisalmi', 'Kuopio']'

如果不是很明显，问题是Python内部更喜欢在列表中的字符串周围加上单引号;因此，它生成无效的JSON。

简单的解决方法可能是将这些值强制转换为JSON格式，这样您就不必更改其余的代码。

import json
...
subprocess.call(['bash',
'sof.sh'] +
[x + "=" + json.dumps(params[x]) for x in params.keys()])

这会生成所有值的列表，因为您的params值都是列表。如果你不希望查询和语言是列表(即不希望它们周围有方括号)，请在Python代码中params字典的定义中去掉它们周围的方括号。

相关内容

最新更新

热门标签：