Raspberry Pi 上的 Airflow 安装未找到 BashOperator

Question

我不确定如何解决这个问题——与 ModuleNotFoundError 有关的其他帖子已通过重新安装相关包解决，但很明显这不是问题，因为示例 bash 运算符 DAG 运行。那么我的问题与 Airflow 的安装方式有关吗？此时我正在考虑通过 puckel Docker container.

重新安装 Airflow

[2020-12-23 01:02:24,705] {dagbag.py:259} ERROR - Failed to import: /home/pi/airflow/dags/dag_clist.py

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/dist-packages/airflow/models/dagbag.py", line 256, in process_file
    m = imp.load_source(mod_name, filepath)
  File "/usr/lib/python3.7/imp.py", line 171, in load_source
    module = _load(spec)
  File "<frozen importlib._bootstrap>", line 696, in _load
  File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/pi/airflow/dags/dag_clist.py", line 7, in <module>
    from airflow.operators.bash import BashOperator
ModuleNotFoundError: No module named 'airflow.operators.bash'

与 BashOperator 有关的其他 SO 帖子：

pandas
spark

Answer 1

由于您使用的是 Airflow 1.10.14 导入应该是

from airflow.operators.bash_operator import BashOperator

在 Airflow >= 2.0.0 中是：

from airflow.operators.bash import BashOperator

Raspberry Pi 上的 Airflow 安装未找到 BashOperator

BashOperator not found on Airflow install on Raspberry Pi

python

raspberry-pi

airflow