从雅虎股票网站解析股票推荐评级

Question

我正在寻找使用 Python 脚本（以 https://finance.yahoo.com/quote/NOA?ltr=1 为例）解析特定的 Yahoo 股票页面并将 "Recommended Rating" 打印到文件中。推荐评级可以在页面右侧大约一半的位置找到。

这是我目前所拥有的

  try:
    import urllib.request as urllib2
except ImportError:
    import urllib2
from bs4 import BeautifulSoup
quote_page = 'https://finance.yahoo.com/quote/NOA?ltr=1'
page = urllib2.urlopen(quote_page)
soup = BeautifulSoup(page, "html.parser")
name_box = soup.find(attrs={'div': 'rating-text Arrow South Fw(b) Bgc($strongBuy) Bdtc($strongBuy)'})
name = name_box.text.strip()
print(name)

棘手的部分是我认为推荐评级仅作为 InnerHTML 在页面上列出。我不确定我将如何检索这些数据，我们将不胜感激向正确方向的推动！

Answer 1

有一个 API 用于访问雅虎财经信息，例如

http://finance.yahoo.com/d/quotes.csv?s=NOA&f=snd1l1yr

我认为您最好使用它来获取所需信息。可以在此处找到有关参数的更多信息： http://wern-ancheta.com/blog/2015/04/05/getting-started-with-the-yahoo-finance-api/

Answer 2

Yahoo 在下面的脚本中向 url 发出获取请求以获取他们的一些数据。如果您查看开发人员工具的网络选项卡并刷新 NOA 库存页面，您应该会看到 'NOA?formatt...'。单击此按钮，然后查看响应对象以查看一些数据。您需要以下脚本的请求模块才能工作：pip install requests.

# get_mean_recs.py
import csv
from datetime import datetime
import requests
import sys

get_date = lambda : datetime.utcnow().strftime('%d-%m-%Y')

lhs_url = 'https://query2.finance.yahoo.com/v10/finance/quoteSummary/'
rhs_url = '?formatted=true&crumb=swg7qs5y9UP&lang=en-US&region=US&' \
          'modules=upgradeDowngradeHistory,recommendationTrend,' \
          'financialData,earningsHistory,earningsTrend,industryTrend&' \
          'corsDomain=finance.yahoo.com'

def get_mean_rec(ticker):
    url =  lhs_url + ticker + rhs_url
    r = requests.get(url)
    if not r.ok:
        return -1
    result = r.json()['quoteSummary']['result'][0]
    return result['financialData']['recommendationMean']['fmt']

def read_from_csv(fn):
    with open(fn, 'r') as f:
        reader = csv.reader(f)
        for line in reader:
            for ticker in line:
                yield ticker

def write_to_csv(fn, data):
    with open(fn, 'a') as f:
        fieldnames = data[0].keys()
        writer = csv.DictWriter(f, fieldnames=fieldnames)
        for item in data:
            writer.writerow(item)

def assemble_dict(ticker):
    return {
        'ticker': ticker,
        'mean_rec': get_mean_rec(ticker),
        'utc_date': get_date()
    }

def main():
    in_fn = sys.argv[1]
    out_fn = sys.argv[2]
    data = [assemble_dict(ticker) for ticker in read_from_csv(in_fn)]
    write_to_csv(out_fn, data)

if __name__ == '__main__':
    main()

用法：

python get_mean_recs.py input.csv output.csv

从雅虎股票网站解析股票推荐评级

Parsing stock recommended rating from Yahoo stock site

html

python

parsing

stocks

web-scraping