为什么我不能使用请求库访问网站，而我仍然可以从浏览器访问它？

Question

我有访问网站的功能

def access_website(link):
        
    try:
        
        cert = requests.certs.where()
        page = requests.get(link, 
                            verify=cert, 
                            headers={"User-Agent": "Mozilla/5.0 (X11; CrOS x86_64 12871.102.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.141 Safari/537.36"})
                
        return page

    except Exception as x:
        print(x)
        return ''

access_website('https://www.davita.com/-/media/davita/project/kidneycare/pdf/corporate-governance/dva-pay-equity-disclosure-32119-final.ashx?la=en-us&hash=E5E2F4F69620F3C0BB52FFE818ABCE6CD36BFA12')

但是当我这样做时，出现以下错误：

HTTPSConnectionPool(host='www.davita.com', port=443): Max retries exceeded with url: /-/media/davita/project/kidneycare/pdf/corporate-governance/dva-pay-equity-disclosure-32119-final.ashx?la=en-us&hash=E5E2F4F69620F3C0BB52FFE818ABCE6CD36BFA12 (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1123)')))

但我可以轻松地从浏览器访问该站点。我拥有的所有其他链接都不会引发此错误。

我该如何解决这个问题？我已经试过提供证书了，还是不行

Answer 1

您可以设置 verify=False 参数：

import requests

def access_website(link):
    HEADERS = {
        "User-Agent": "Mozilla/5.0 (X11; CrOS x86_64 12871.102.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.141 Safari/537.36"
    }
    
    try:
        page = requests.get(link, verify=False, headers=HEADERS)

        return page

    except Exception as x:
        print(x)
        return ""


access_website(
    "https://www.davita.com/-/media/davita/project/kidneycare/pdf/corporate-governance/dva-pay-equity-disclosure-32119-final.ashx?la=en-us&hash=E5E2F4F69620F3C0BB52FFE818ABCE6CD36BFA12"
)

为什么我不能使用请求库访问网站，而我仍然可以从浏览器访问它？

Why can't I use requests library to access a website while I can still visit it from the browser?

python

ssl-certificate

python-requests