希望任何人都可以帮助我。我是Python的新手,但我想从一个网站上刮擦数据,不幸的是,该网站需要一个帐户。尽管我无法提取日期(即2017-06-01(。
<li class="latest-value-item">
<div class="latest-value-label">Date</div>
<div class="latest-value">2017-06-01</div>
</li>
<li class="latest-value-item">
<div class="latest-value-label">Index</div>
<div class="latest-value">1430</div>
</li>
这是我的代码:
import urllib3
import urllib.request
from bs4 import BeautifulSoup
import pandas as pd
import requests
import csv
from datetime import datetime
url = 'https://www.quandl.com/data/LLOYDS/BCI-Baltic-Capesize-Index'
r = requests.get(url)
soup = BeautifulSoup(r.text, 'lxml')
Baltic_Indices = []
New_Value = []
#new = soup.find_all('div', attrs={'class':'latest-value'}).get_text()
date = soup.find_all(class_="latest value")
text1 = date.text
print(text1)
date = soup.find_all(class_="latest value")
您正在使用错误的CSS类名称('latest value' != 'latest-value'
(
print(soup.find_all(attrs={'class': 'latest-value'}))
# [<div class="latest-value">2017-06-01</div>, <div class="latest-value">1430</div>]
for element in soup.find_all(attrs={'class': 'latest-value'}):
print(element.text)
# 2017-06-01
# 1430
我更喜欢使用attrs
Kwarg,但您的方法也有效(给定正确的CSS类名称(
for element in soup.find_all(class_='latest-value'):
print(element.text)
# 2017-06-01
# 1430