我正在尝试下载>使用python的网站提供的100 pdf。但是,这些pdf隐藏在选择选项下。例如:
- 选项1
- 选项2
- 选项3
然后,如果我选择选项1,我会撒谎:
- 选项1
- 可点击的信息链接1〔可点击的文件链接1〕
- 可点击的信息链接2[可点击的文件链接2]
- 信息3的可点击链接[文件3的可单击链接]
- 可点击的信息链接4[可点击的文件链接4]
- 选项2
- 选项3
一旦我按下,例如,";指向文件1的可点击链接";,图片弹出并带有";查看PDF";在弹出窗口的右上角。现在,我如何为选项1下的每个文件循环下载PDF?我是网络聊天的新手,非常感谢你的帮助。
谢谢!
似乎可以根据链接标识符自动构建PDF Url。例如:
import requests
from bs4 import BeautifulSoup
url = "https://www12.statcan.gc.ca/census-recensement/2016/dp-pd/prof/search-recherche/lst/results-resultats.cfm?Lang=E&TABID=1&G=1&Geo1=&Code1=&Geo2=&Code2=&GEOCODE=35&type=0"
map_url = "https://www12.statcan.gc.ca/census-recensement/geo/maps-cartes/pdf/{id1}/{id2}.pdf"
soup = BeautifulSoup(requests.get(url).content, "html.parser")
for a in soup.select("a[data-dguid]"):
id_ = a["data-dguid"]
m = map_url.format(id1=id_[4:9], id2=id_)
print("{:<60} {}".format(a["data-geoname"], m))
打印:
...
Map: Arthur [Population center], Ontario https://www12.statcan.gc.ca/census-recensement/geo/maps-cartes/pdf/S0510/2016S05100022.pdf
Map: Atikokan [Population center], Ontario https://www12.statcan.gc.ca/census-recensement/geo/maps-cartes/pdf/S0510/2016S05100028.pdf
Map: Attawapiskat 91A [Population center], Ontario https://www12.statcan.gc.ca/census-recensement/geo/maps-cartes/pdf/S0510/2016S05101497.pdf
Map: Aylmer [Population center], Ontario https://www12.statcan.gc.ca/census-recensement/geo/maps-cartes/pdf/S0510/2016S05100030.pdf
Map: Ayr [Population center], Ontario https://www12.statcan.gc.ca/census-recensement/geo/maps-cartes/pdf/S0510/2016S05100031.pdf
Map: Azilda [Population center], Ontario https://www12.statcan.gc.ca/census-recensement/geo/maps-cartes/pdf/S0510/2016S05101498.pdf
Map: Ballantrae [Population center], Ontario https://www12.statcan.gc.ca/census-recensement/geo/maps-cartes/pdf/S0510/2016S05101370.pdf
Map: Barrie [Population center], Ontario https://www12.statcan.gc.ca/census-recensement/geo/maps-cartes/pdf/S0510/2016S05100043.pdf
Map: Barry's Bay [Population center], Ontario https://www12.statcan.gc.ca/census-recensement/geo/maps-cartes/pdf/S0510/2016S05100044.pdf
Map: Bath [Population center], Ontario https://www12.statcan.gc.ca/census-recensement/geo/maps-cartes/pdf/S0510/2016S05101403.pdf
...