Business
Jobs
  • About Us
  • Solutions
    • Job Postings
      Post your job and receive qualified candidates in 48h.
    • Candidate Assessments
      500+ technical and psychological tests, plus anti-fraud.
    • Headhunting
      Tailor-made executive search from start to finish.
    • Payroll + EOR
      Payroll dispersal and EOR across 15+ LATAM countries.
  • Pricing
  • Jobs

0

702
Views
Airflow: no se puede acceder a los proveedores de AWS

Estoy tratando de acceder a los proveedores de Airflow, específicamente a los proveedores de AWS, que se encuentran aquí

Estoy creando una imagen acoplable e instalando Airflow usando PIP e incluyendo el subpaquete de AWS en el comando de instalación.

pip install 'apache-airflow[crypto,aws,celery,postgres,hive,jdbc,mysql,ssh]==1.10.9' \

Sin embargo, no puedo acceder al proveedor desde Python.

 from airflow.providers.amazon.aws.hooks.glue import AwsGlueJobHook
 >>> from airflow.providers.amazon.aws.hooks.glue import * Traceback (most recent call last): File "<stdin>", line 1, in <module> ModuleNotFoundError: No module named 'airflow.providers'

La carpeta de proveedores no se ha instalado.

 total 184 -rw-r--r-- 1 root root 833 Apr 17 15:25 version.py -rw-r--r-- 1 root root 13682 Apr 17 15:25 settings.py -rw-r--r-- 1 root root 5281 Apr 17 15:25 sentry.py -rw-r--r-- 1 root root 8942 Apr 17 15:25 plugins_manager.py -rw-r--r-- 1 root root 3833 Apr 17 15:25 logging_config.py -rw-r--r-- 1 root root 3232 Apr 17 15:25 __init__.py -rw-r--r-- 1 root root 3503 Apr 17 15:25 exceptions.py -rw-r--r-- 1 root root 2646 Apr 17 15:25 default_login.py -rw-r--r-- 1 root root 26086 Apr 17 15:25 configuration.py -rw-r--r-- 1 root root 2237 Apr 17 15:25 alembic.ini drwxr-xr-x 6 root root 4096 Apr 17 15:25 www_rbac drwxr-xr-x 6 root root 4096 Apr 17 15:25 www drwxr-xr-x 5 root root 4096 Apr 17 15:25 _vendor drwxr-xr-x 4 root root 4096 Apr 17 15:25 utils drwxr-xr-x 4 root root 4096 Apr 17 15:25 ti_deps drwxr-xr-x 4 root root 4096 Apr 17 15:25 task drwxr-xr-x 3 root root 4096 Apr 17 15:25 serialization drwxr-xr-x 3 root root 4096 Apr 17 15:25 sensors drwxr-xr-x 3 root root 4096 Apr 17 15:25 security drwxr-xr-x 2 root root 4096 Apr 17 15:25 __pycache__ drwxr-xr-x 3 root root 4096 Apr 17 15:25 operators drwxr-xr-x 3 root root 4096 Apr 17 15:25 models drwxr-xr-x 4 root root 4096 Apr 17 15:25 migrations drwxr-xr-x 3 root root 4096 Apr 17 15:25 macros drwxr-xr-x 4 root root 4096 Apr 17 15:25 lineage drwxr-xr-x 3 root root 4096 Apr 17 15:25 jobs drwxr-xr-x 3 root root 4096 Apr 17 15:25 hooks drwxr-xr-x 3 root root 4096 Apr 17 15:25 executors drwxr-xr-x 4 root root 4096 Apr 17 15:25 example_dags drwxr-xr-x 3 root root 4096 Apr 17 15:25 dag drwxr-xr-x 12 root root 4096 Apr 17 15:25 contrib drwxr-xr-x 3 root root 4096 Apr 17 15:25 config_templates drwxr-xr-x 3 root root 4096 Apr 17 15:25 bin drwxr-xr-x 6 root root 4096 Apr 17 15:25 api airflow@eaf772874a0b:/usr/local/lib/python3.7/site-packages/airflow$

Cualquier ayuda es muy apreciada.

over 4 years ago · Santiago Trujillo
2 answers
Answer question

0

El paquete de proveedores ya no se incluye con Airflow, pero puede instalarlos por separado con pip usando el paquete backport específico, para aws puede usar:

 pip install apache-airflow-backport-providers-amazon

Puede encontrar más información aquí: Airflow Amazon Provider

over 4 years ago · Santiago Trujillo Report

0

El paquete de proveedores actualmente es solo para la sucursal de Airflow Master.

Si desea verificar qué operadores están disponibles en su versión, verifique el código para esa versión específica, por ejemplo: https://github.com/apache/airflow/tree/1.10.10 o https://airflow.apache.org /docs/1.10.10/_api/index.html

over 4 years ago · Santiago Trujillo Report
Answer question
Find remote jobs

Discover the new way to find a job!

Top jobs
Top job categories
Business
Post vacancy Pricing Sales
Legal
Terms and conditions Privacy policy
© 2026 PeakU Inc. All Rights Reserved.
Andres GPT
Show me some job opportunities
There's an error!