我的代码 returns HTTP 错误 403：禁止访问

Question

from urllib.request import urlopen as uReq
from bs4 import BeautifulSoup as soup

myUrl = "https://mee6.xyz/levels/159962941502783488"

uClient = uReq(myUrl)
pageHtml = uClient.read()
print("pageHtml)

我正在尝试访问一个页面以开始抓取它，但它回复说 HTTP 被禁止，我查看了其他结果，但它们与我的代码不符

Answer 1

由于您的用户代理，您被阻止了。尝试像这样欺骗您的用户代理：

from urllib.request import urlopen as uReq
from urllib.request import Request
from bs4 import BeautifulSoup as soup

myUrl = "https://mee6.xyz/levels/159962941502783488"

req = Request(
    myUrl, 
    data=None, 
    headers={
        'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.181 Safari/537.36'
    }
)

uClient = uReq(req)
pageHtml = uClient.read()
print(pageHtml)

我的代码 returns HTTP 错误 403：禁止访问

My code returns HTTP Error 403: Forbidden

python

screen-scraping

urllib

beautifulsoup

request