网络抓取时出现 AttributeError

Question

网络抓取时收到 AttributeError 但我不确定我做错了什么？ AttributeError 是什么意思？

    response_obj = requests.get('https://en.wikipedia.org/wiki/Demographics_of_New_York_City').text
    soup = BeautifulSoup(response_obj,'lxml')
    Population_Census_Table = soup.find('table', {'class':'wikitable sortable'})

准备 table

    rows = Population_Census_Table.select("tbody > tr")[3:8]

    jurisdiction = []

    for row in rows:
        jurisdiction = {}
        tds = row.select('td')
        jurisdiction["jurisdiction"] = tds[0].text.strip()
        jurisdiction["population_census"] = tds[1].text.strip()
        jurisdiction["%_white"] = float(tds[2].text.strip().replace(",",""))
        jurisdiction["%_black_or_african_amercian"] = float(tds[3].text.strip().replace(",",""))
        jurisdiction["%_Asian"] = float(tds[4].text.strip().replace(",",""))
        jurisdiction["%_other"] = float(tds[5].text.strip().replace(",",""))
        jurisdiction["%_mixed_race"] = float(tds[6].text.strip().replace(",",""))
        jurisdiction["%_hispanic_latino_of_other_race"] = float(tds[7].text.strip().replace(",",""))
        jurisdiction["%_catholic"] = float(tds[7].text.strip().replace(",",""))
        jurisdiction["%_jewish"] = float(tds[8].text.strip().replace(",",""))
    
        jurisdiction.append(jurisdiction)

` `print(jurisdiction)

AttributeError

   ---> 18     jurisdiction.append(jurisdiction)
   AttributeError: 'dict' object has no attribute 'append'

Answer 1

你从 jurisdiction 作为列表开始，然后立即将其作为字典。然后，您将其视为 dict 直到出现错误行，在那里您尝试再次将其视为列表。我认为您需要在开始时为列表起另一个名字。可能您的意思是 jurisdictions（复数）作为列表。然而，IMO 还有两个其他领域也肯定需要修复：

找到returns一个table。你的字典中的 labels/keys 表明你想要稍后 table （不是第一场比赛）
您的目标索引不正确 table

你想要这样的东西：

import requests, re
from bs4 import BeautifulSoup

response_obj = requests.get('https://en.wikipedia.org/wiki/Demographics_of_New_York_City').text
soup = BeautifulSoup(response_obj,'lxml')
Population_Census_Table = soup.select_one('.wikitable:nth-of-type(5)') #use css selector to target correct table.
jurisdictions = []
rows = Population_Census_Table.select("tbody > tr")[3:8]
for row in rows:
    jurisdiction = {}
    tds = row.select('td')
    jurisdiction["jurisdiction"] = tds[0].text.strip()
    jurisdiction["population_census"] = tds[1].text.strip()
    jurisdiction["%_white"] = float(tds[2].text.strip().replace(",",""))
    jurisdiction["%_black_or_african_amercian"] = float(tds[3].text.strip().replace(",",""))
    jurisdiction["%_Asian"] = float(tds[4].text.strip().replace(",",""))
    jurisdiction["%_other"] = float(tds[5].text.strip().replace(",",""))
    jurisdiction["%_mixed_race"] = float(tds[6].text.strip().replace(",",""))
    jurisdiction["%_hispanic_latino_of_other_race"] = float(tds[7].text.strip().replace(",",""))
    jurisdiction["%_catholic"] = float(tds[10].text.strip().replace(",",""))
    jurisdiction["%_jewish"] = float(tds[12].text.strip().replace(",",""))
    jurisdictions.append(jurisdiction)

网络抓取时出现 AttributeError

AttributeError when webscraping

python

beautifulsoup

attributeerror

web-scraping