从纳斯达克下载所有的上市与链接到json文件

Question

我一直在尝试用代码下载文件，到目前为止没有成功，希望有人能帮助。

单元一直加载几个小时没有结果，除非中断(浏览器加载秒)
执行只是卡在get请求永远…

import requests
url = "https://api.nasdaq.com/api/screener/stocks?tableonly=true&limit=25&offset=0&download=true"
data = requests.get(url)

Answer 1

nasdaq.api有适当的措施来防止网页抓取。您需要设置额外的头信息，以便能够访问此处推荐的数据..

请尝试以下代码:

import pandas as pd
import requests
url = 
'https://api.nasdaq.com/api/screener/stocks?tableonly=true&limit=25&offset=0&download=true'
headers = {'Accept-Language': 'en-US,en;q=0.9',
'Accept-Encoding': 'gzip, deflate, br',
'User-Agent': 'Java-http-client/'}
response = requests.get(url, headers=headers)
# get json response
json = response.json()
# extract relevant keys
df = pd.DataFrame(json['data']['rows'])
df

输出:

symbol  name    lastsale    netchange   pctchange   volume  marketCap   country ipoyear industry    sector  url
0   A   Agilent Technologies Inc. Common Stock  $135.71 -0.70   -0.513% 1403731 40728386393.00  United States   1999    Electrical Products Capital Goods   /market-activity/stocks/a
1   AA  Alcoa Corporation Common Stock  $91.96  -3.10   -3.261% 6036063 16959331342.00      2016    Metal Fabrications  Basic Industries    /market-activity/stocks/aa
2   AAC Ares Acquisition Corporation Class A Ordinary ...   $9.78   -0.01   -0.102% 3176    1222500000.00       2021    Business Services   Finance /market-activity/stocks/aac