网页抓取以在您的管中查找实时视图

Question

我在下面写了代码来找出来自 youtube 频道的实时观看计数，但它没有返回任何输出。

import requests
from bs4 import BeautifulSoup
res=requests.get("https://www.youtube.com/watch?v=LEgv0arvI1o")
data = BeautifulSoup(res.text, 'lxml')
livewatching=data.find("span", {"class" : "view-count style-scope yt-view-count-renderer"})
print (livewatching)

Answer 1

您可以使用Selenium自动执行打开浏览器的过程并找到所需的元素。(不要忘记在浏览器上允许远程自动化(

from selenium import webdriver
from selenium.webdriver.support.ui import WebDriverWait
driver=webdriver.Safari()
driver.get("https://www.youtube.com/watch?v=LEgv0arvI1o")
streamcount = "//*[@id='count']/yt-view-count-renderer/span[1]"
streamcountelement = WebDriverWait(driver,10).until(lambda driver: 
driver.find_element_by_xpath(streamcount))
print(streamcountelement.text)