Aws Airflow 2.7.2 安装 paramiko 3.3.1 错误

Question

我正在将气流从 1.10.12 升级到 2.7.2，将 python 3.6 升级到 3.11.7 并尝试安装我的库，但在 Paramiko 上出现错误

但我已经尝试安装 bcrypt，因为它说依赖项兼容性，但每次它的每个版本我都会遇到此错误：

ERROR: bcrypt-3.2.0-cp36-abi3-musllinux_1_1_x86_64.whl is not a supported wheel on this platform.

ERROR: bcrypt-4.0.1-pp39-pypy39_pp73-manylinux_2_28_x86_64.whl is not a supported wheel on this platform.

我的requirements.txt文件是这样的：

我尝试过更改版本，whl 的系统（操作系统版本：4.14.336-253.554.amzn2.x86_64），但我总是收到相同的错误，即该平台上不支持轮子。

Answer 1

命令行界面 (CLI) 实用程序在本地复制 Amazon Managed Workflows for Apache Airflow 环境。

CLI 在本地构建类似于 Amazon MWAA 生产映像的 Docker 容器映像。这允许您在部署到 Amazon MWAA 之前运行本地 Apache Airflow 环境来开发和测试 DAG、自定义插件和依赖项。

要运行 CLI，请参阅 GitHub 上的 aws-mwaa-local-runner。

通过此文件使用本地运行程序。

--constraint "https://raw.githubusercontent.com/apache/airflow/constraints-2.7.2/constraints-3.11.txt"
paramiko==3.3.1
xmlschema==3.0.1
elementpath==4.1.5
et_xmlfile==1.1.0
openpyxl==3.1.2
jmespath==0.10.0
s3transfer==0.6.2
six==1.16.0
botocore==1.31.17
boto3==1.28.17
bcrypt==4.0.1

test-requirements 命令构建成功

--constraint "https://raw.githubusercontent.com/apache/airflow/constraints-2.7.2/constraints-3.11.txt"
Installing requirements.txt
Collecting paramiko==3.3.1
  Downloading paramiko-3.3.1-py3-none-any.whl (224 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 224.8/224.8 kB 3.3 MB/s eta 0:00:00
Collecting xmlschema==3.0.1
  Downloading xmlschema-3.0.1-py3-none-any.whl (405 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 405.2/405.2 kB 5.9 MB/s eta 0:00:00
Collecting elementpath==4.1.5
  Downloading elementpath-4.1.5-py3-none-any.whl (216 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 216.4/216.4 kB 9.5 MB/s eta 0:00:00
Collecting et_xmlfile==1.1.0
  Downloading et_xmlfile-1.1.0-py3-none-any.whl (4.7 kB)
Collecting openpyxl==3.1.2
  Downloading openpyxl-3.1.2-py2.py3-none-any.whl (249 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 250.0/250.0 kB 8.8 MB/s eta 0:00:00
Requirement already satisfied: jmespath==0.10.0 in ./.local/lib/python3.11/site-packages (from -r /usr/local/airflow/requirements/requirements.txt (line 7)) (0.10.0)
Requirement already satisfied: s3transfer==0.6.2 in ./.local/lib/python3.11/site-packages (from -r /usr/local/airflow/requirements/requirements.txt (line 8)) (0.6.2)
Requirement already satisfied: six==1.16.0 in ./.local/lib/python3.11/site-packages (from -r /usr/local/airflow/requirements/requirements.txt (line 9)) (1.16.0)
Requirement already satisfied: botocore==1.31.17 in ./.local/lib/python3.11/site-packages (from -r /usr/local/airflow/requirements/requirements.txt (line 10)) (1.31.17)        
Requirement already satisfied: boto3==1.28.17 in ./.local/lib/python3.11/site-packages (from -r /usr/local/airflow/requirements/requirements.txt (line 11)) (1.28.17)
Collecting bcrypt==4.0.1
  Downloading bcrypt-4.0.1-cp36-abi3-manylinux_2_28_x86_64.whl (593 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 593.7/593.7 kB 9.7 MB/s eta 0:00:00
Requirement already satisfied: cryptography>=3.3 in ./.local/lib/python3.11/site-packages (from paramiko==3.3.1->-r /usr/local/airflow/requirements/requirements.txt (line 2)) (41.0.4)
Collecting pynacl>=1.5
  Downloading PyNaCl-1.5.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (856 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 856.7/856.7 kB 11.6 MB/s eta 0:00:00
Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in ./.local/lib/python3.11/site-packages (from botocore==1.31.17->-r /usr/local/airflow/requirements/requirements.txt (line 10)) (2.8.2)
Requirement already satisfied: urllib3<1.27,>=1.25.4 in ./.local/lib/python3.11/site-packages (from botocore==1.31.17->-r /usr/local/airflow/requirements/requirements.txt (line 10)) (1.26.17)
Requirement already satisfied: cffi>=1.12 in ./.local/lib/python3.11/site-packages (from cryptography>=3.3->paramiko==3.3.1->-r /usr/local/airflow/requirements/requirements.txt (line 2)) (1.16.0)
Requirement already satisfied: pycparser in ./.local/lib/python3.11/site-packages (from cffi>=1.12->cryptography>=3.3->paramiko==3.3.1->-r /usr/local/airflow/requirements/requirements.txt (line 2)) (2.21)
Installing collected packages: et_xmlfile, elementpath, bcrypt, xmlschema, pynacl, openpyxl, paramiko
Successfully installed bcrypt-4.0.1 elementpath-4.1.5 et_xmlfile-1.1.0 openpyxl-3.1.2 paramiko-3.3.1 pynacl-1.5.0 xmlschema-3.0.1

aws mwaa 最佳实践依赖项