我正在使用Urllib提取网页，并且似乎与Zomato的网站无法使用。它可以与我尝试过的其他几个站点一起使用。当我在这里发现时，我尝试过禁用防火墙，防病毒软件并将urlopen系列包裹在Try Catch中。我尝试使用似乎正常工作的互联网代码，但是我收到了一个错误消息，
v = self._sslobj.read（len或1024） socket.Error：[ERRNO 10060]连接尝试失败了，因为连接的方在一段时间后没有正确响应，或者建立的连接失败了，因为连接的主机未能做出响应。
可能的原因是什么？
这是它的简单代码。
import urllib2
from bs4 import BeautifulSoup
def extract_link(url):
page = urllib2.urlopen(url).read()
return BeautifulSoup(page)
def main():
link = 'https://www.zomato.com/kolkata'
soup=extract_link(link)
print soup.prettify()
if __name__== '__main__':
main()
因为zomato.com是一个动态的网站，并且很大程度上依赖JavaScript或Ajax来填写其内容，因此您需要浏览器才能获取该内容。最重要的是，Zomato滤除了它认为是由机器人提出的请求。因此，由于这些原因，我建议您使用硒，因为它不会模拟浏览器会话，而是浏览器会话。为硒写作基本上是写一组动作，并将其喂入浏览器（通常是Firefox，但可以与他人一起使用）。您也可以使用phantomjs作为替代方案，因为您正在与Python合作。
这在设置硒和复制上述代码方面有一点帮助。
- 从https://chromedriver.storage.storage.googleapis.com/index.html？path = 2.25/
- 然后将此.exe文件提取到" Chrome Driver"文件夹中。
- 然后将包含文件的文件夹剪切并粘贴到您的C驱动器中。
- 现在，做
pip install selenium.
然后运行此代码
import time
from selenium import webdriver
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC
driver = webdriver.Chrome("C:Chrome Driverchromedriver")
driver.get("https://www.zomato.com/kolkata")
time.sleep(3)
wait = WebDriverWait(driver, 30)
body = wait.until(EC.presence_of_element_located((By.XPATH,"/html/body")))
print(body.text)
这是您将获得的输出：
We're Hiring!
Order Food Online!
Log in
Find the best restaurants, cafés, and bars in Kolkata
Kolkata
Search
Collections
Explore curated lists of top restaurants, cafes, pubs, and bars in and around Kolkata, based on trends
Trending this week
The most popular restaurants in town this week
New restaurants you probably haven't tried yet
The best new places in town
Happy hours
Great deals on booze. Happy hours indeed
Hookah bars
Great places to enjoy flavored Hookah.
All collections in Kolkata
Order Food Online
From the best restaurants delivering to your doorstep
Enter your delivery location
Detect
Order Food Online!
Get 15% off (up to Rs. 100) on your first order with the code EATIN when you pay online.
Quick Searches
Discover restaurants by type of meal
Delivery
Breakfast
Lunch
Dinner
Drinks & Nightlife
Cafés
Pocket-Friendly Delivery
Desserts & Bakes
Popular localities in and around Kolkata
Explore restaurants, bars, and cafés by locality
Park Street Area (111 places)
Sector 5, Salt Lake (102 places)
Ballygunge (154 places)
Sector 1, Salt Lake (167 places)
Rajarhat New Town (212 places)
Southern Avenue (86 places)
Elgin (81 places)
Prince Anwar Shah Road (108 places)
Kankurgachi (116 places)
Kasba (118 places)
Camac Street Area (61 places)
Gariahat (62 places)
Park Circus Area (80 places)
Desapriya Park (61 places)
New Market Area (105 places)
Behala (136 places)
Hindustan Park (30 places)
Hatibagan (70 places)
Sector 3, Salt Lake (83 places)
Esplanade (64 places)
Jadavpur (91 places)
Golpark (37 places)
Bhawanipur (100 places)
Science City Area (19 places)
Theatre Road (47 places)
Shyam Bazar (54 places)
Garia (108 places)
Tangra (32 places)
Nagerbazar (60 places)
Tollygunge (110 places)
Top Reviewers in Kolkata
Pamela Nandi
446 Reviews , 245 Followers
Follow
Dipyaman Basu
883 Reviews , 5854 Followers
Follow
Anusreea Paul
613 Reviews , 2114 Followers
Follow
Krishanu Das
832 Reviews , 1599 Followers
Follow
Priyabrataa Ganguly
536 Reviews , 683 Followers
Follow
Reviewers leaderboard »
Top Photographers in Kolkata
Avijit Biswas
698 Reviews , 1381 Followers
Follow
Krishanu Das
832 Reviews , 1599 Followers
Follow
Mani
153 Reviews , 4473 Followers
Follow
Anusreea Paul
613 Reviews , 2114 Followers
Follow
Anamitraa Chakraborty
610 Reviews , 1255 Followers
Follow
Photographers leaderboard »
Top Bloggers in Kolkata
Arghya Deep
137 Reviews , 3498 Followers
Follow
Subham Ghosh
208 Reviews , 6497 Followers
Follow
Snehasis
230 Reviews , 929 Followers
Follow
Koninika De
356 Reviews , 4695 Followers
Follow
Dipyaman Basu
883 Reviews , 5854 Followers
Follow
Bloggers leaderboard»
Looking for the Food Feed? Get the app!
Follow foodies to see their reviews and photos in your Feed, and discover great new restaurants!
We'll send you a link, open it on your phone to download the app
Text App Link
OR
Email App Link
23
COUNTRIES
1.2M
RESTAURANTS
80M
FOODIES EVERY MONTH
30M
PHOTOS
10M
REVIEWS
18M
BOOKMARKS
About Careers Culture Mobile Apps Businesses Developers Blog Community Contact
English
Businesses
Add a Restaurant
Claim your Listing
Business App
Restaurant Widgets
Guidelines
Business Blog
Advertise
Book
Order
Base
Whitelabel
Countries
Australia
Brasil
Canada
Chile
Czech Republic
India
Indonesia
Ireland
Italy
Lebanon
Malaysia
New Zealand
Philippines
Poland
Portugal
Qatar
Slovakia
South Africa
Sri Lanka
Turkey
UAE
United Kingdom
United States
Privacy Terms Code of Conduct API Policy CSR Security Sitemap
By continuing past this page, you agree to our Terms of Service, Cookie Policy, Privacy Policy and Content Policies. All trademarks are properties of their respective owners. © 2008-2016 - Zomato™ Media Pvt Ltd. All rights reserved.