为什么我没有在美丽汤蟒蛇中获得完整的div？

Question

我的代码

import requests
from bs4 import BeautifulSoup
URL = "https://www.quora.com/profile/Siddhartha-gaur-5"
r = requests.get(URL)

soup = BeautifulSoup(r.content,'html5lib')
for data in soup.find("div", id="root"): 
print(data)

我得到一个空白的div标签，没有内容，如下所示。

<div id="root"></div>

我想提取的所有内容在这个例子中给出:完成div......

Answer 1

下面是工作代码

import requests
from bs4 import BeautifulSoup
from selenium import webdriver
# MAIN
driver = webdriver.Chrome('cromedriver path here')
driver.maximize_window()

#Go to link
URL = "https://www.quora.com/profile/Siddhartha-gaur-5"
driver.get(URL)
soup = BeautifulSoup(driver.page_source,'lxml')
driver.close()
for data in soup.find("div", id="root"): 
print(data)