蟒蛇网页刮汤.找给空

Question

为什么 a 和价格是空的，而不是从汤中提取值，即使汤也有数据

'''

import requests
from bs4 import BeautifulSoup
import csv
import re
r = requests.get('https://www.daraz.pk/catalog/?q=iphone&_keyori=ss&from=input&spm=a2a0e.home.search.go.35e34937c3qzgp')
soup = BeautifulSoup(r.text, 'html.parser')
products=[] #List to store name of the product
prices=[] #List to store price of the product
ratings=[] #List to store rating of the product
for item in soup.find_all(class_='c3gUW0'):
prices.append(item.text)
a=soup.find(class_='c3gUW0')
a**strong text**

'''

Answer 1

网站是动态加载的，因此requests模块不支持它。但是，数据以JSON格式嵌入在网站上，您可以使用内置的re(regex)模块查找数据，并使用内置的json模块将其转换为Python字典(dict))。

例如，要打印名称和价格：

import re
import json
import requests
from bs4 import BeautifulSoup
URL = "https://www.daraz.pk/catalog/?q=iphone&_keyori=ss&from=input&spm=a2a0e.home.search.go.35e34937c3qzgp"
soup = BeautifulSoup(requests.get(URL).content, "html.parser")
data = json.loads(re.search(r"window.pageData=({.*})", str(soup)).group(1))
for d in data["mods"]["listItems"]:
print("Description:", d["name"])
print("Price:", d["priceShow"])
print('-' * 80)

输出(截断)：

Description: Apple iPhone 12 - 64GB - PTA Approved
Price: Rs. 215,000
--------------------------------------------------------------------------------
Description: iPhone 12 - 128GB - PTA Approved
Price: Rs. 230,000
--------------------------------------------------------------------------------
Description: iPhone 8 Plus - 5.5" Display - 3GB RAM + 64/256GB ROM - Phone Only
Price: Rs. 66,999
--------------------------------------------------------------------------------