从脚本标记(网络抓取)获取信息

Question

#Python Code
from bs4 import BeautifulSoup
import urllib3
url ='https://www. SomeData .com'
req = urllib3.PoolManager()
res = req.request('GET', url)
soup = BeautifulSoup(res.data, 'html.parser')
res = soup.find_all('script')
print(res)

然后我得到了这样的东西：

Results below:
[
  <script>
        AAA.trackData.taxonomy = {
              a:"a",
              b:"b",
              c:"c2,
              ...} ;
</script>
</script>, <script async="" src="https://someData.com/js/detail.0a6eca28.js"></script>
]

我怎样才能将其转换为 json 格式来处理标签内的井数据。

Answer 1

请检查这是否有帮助。

script = soup.find('script', text=re.compile('AAA.trackData.taxonomy'))
json_text = re.search(r'^s*AAA.trackData.taxonomys*=s*({.*?})s*;s*$',
                      script.string, flags=re.DOTALL | re.MULTILINE).group(1)
data = json.loads(json_text)