Windows致命异常：尝试打印漂亮的汤内容时堆栈溢出

Question

我正在尝试打印此 link 中的 beautifulsoup 内容：https://www.sec.gov/Archives/edgar/data/1750/0001047469-11-006302.txt 使用代码

session = requests.Session()
session.headers.update({'User-Agent': 'xxx'})
soup = bs4.BeautifulSoup(session.get(link).content, 'html.parser')
print(soup)

运行代码后，spyder抛出如下错误，并自动重启内核我几乎到处搜索，但没有发现 post 描述这个确切的问题。有人有什么想法吗？

Windows fatal exception: stack overflow


Main thread:
Current thread 0x00002434 (most recent call first):
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\formatter.py", line 123 in attributes
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1640 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  ...


Restarting kernel...

Answer 1

BS4 也使用递归来查找所有元素，Python 有递归限制（检查 sys.getrecursionlimit）。

您遇到的错误可能是由于 HTML 文档的子元素过多。

您可能想使用 sys.setrecursionlimit 来增加限制。例如：

import requests
import bs4
import sys

sys.setrecursionlimit(10000)

session = requests.Session()
session.headers.update({'User-Agent': 'xxx'})
soup = bs4.BeautifulSoup(session.get(link).content, 'html.parser')
print(soup)

请注意，如果您将限制设置得太高，可能会导致 C 堆栈溢出并崩溃 Python。

Windows致命异常：尝试打印漂亮的汤内容时堆栈溢出

Windows fatal exception: stack overflow when trying to print beautiful soup content

python

windows

exception

beautifulsoup