Comments (4)
Looking at the error message, it seems the problem is from your DAG, dagrun_timeout should be a timedelta. It seems you have it misconfigured. Can you share the DAG?
from airflow-client-python.
I will share it in few hours when I log back in.
But as you said regarding dag_run_timeout, I haven't defined this in my dag as it is not a REQUIRED parameter. So I believe python api should be able to handle NoneType if this is not defined in the DAG.
Also just wanted to point out that REST API successfully retrieve the details of the same DAG.
from airflow-client-python.
I am using this DAG from the example on official Airflow website. Please visit this link...
from datetime import timedelta
from textwrap import dedent
# The DAG object; we'll need this to instantiate a DAG
from airflow import DAG
# Operators; we need this to operate!
from airflow.operators.bash import BashOperator
from airflow.utils.dates import days_ago
# These args will get passed on to each operator
# You can override them on a per-task basis during operator initialization
default_args = {
'owner': 'airflow',
'depends_on_past': False,
'email': ['[email protected]'],
'email_on_failure': False,
'email_on_retry': False,
'retries': 1,
'retry_delay': timedelta(minutes=5),
# 'queue': 'bash_queue',
# 'pool': 'backfill',
# 'priority_weight': 10,
# 'end_date': datetime(2016, 1, 1),
# 'wait_for_downstream': False,
# 'dag': dag,
# 'sla': timedelta(hours=2),
# 'execution_timeout': timedelta(seconds=300),
# 'on_failure_callback': some_function,
# 'on_success_callback': some_other_function,
# 'on_retry_callback': another_function,
# 'sla_miss_callback': yet_another_function,
# 'trigger_rule': 'all_success'
}
with DAG(
'tutorial',
default_args=default_args,
description='A simple tutorial DAG',
schedule_interval=timedelta(days=1),
start_date=days_ago(2),
tags=['example'],
) as dag:
# t1, t2 and t3 are examples of tasks created by instantiating operators
t1 = BashOperator(
task_id='print_date',
bash_command='date',
)
t2 = BashOperator(
task_id='sleep',
depends_on_past=False,
bash_command='sleep 5',
retries=3,
)
t1.doc_md = dedent(
"""\
#### Task Documentation
You can document your task using the attributes `doc_md` (markdown),
`doc` (plain text), `doc_rst`, `doc_json`, `doc_yaml` which gets
rendered in the UI's Task Instance Details page.
![img](http://montcs.bloomu.edu/~bobmon/Semesters/2012-01/491/import%20soul.png)
"""
)
dag.doc_md = __doc__ # providing that you have a docstring at the beggining of the DAG
dag.doc_md = """
This is a documentation placed anywhere
""" # otherwise, type it like this
templated_command = dedent(
"""
{% for i in range(5) %}
echo "{{ ds }}"
echo "{{ macros.ds_add(ds, 7)}}"
echo "{{ params.my_param }}"
{% endfor %}
"""
)
t3 = BashOperator(
task_id='templated',
depends_on_past=False,
bash_command=templated_command,
params={'my_param': 'Parameter I passed in'},
)
t1 >> [t2, t3]
from airflow-client-python.
Closing, solved in 2.7.0 same problem originating from wrong usage of the nullable property next to a $ref object.
Feel free to re-open if needed.
Release candidate available here for testing purpose:
https://pypi.org/project/apache-airflow-client/2.7.0rc1/
Stable 2.7.0
client will be released shortly.
from airflow-client-python.
Related Issues (20)
- Is the issues still under monitoring? HOT 4
- Pass verify_ssl as parameter
- Handle pagination for client code HOT 2
- [openapi] wrong use of $ref and nullable HOT 3
- User confirmation needed HOT 2
- issue of get_task_instance HOT 1
- Error - "certificate verify failed - unable to get local issuer certificate" while using airflow_client HOT 2
- Kerberos Authentication Support HOT 1
- SLAMiss not allowing null value HOT 3
- Bug: `DAGApi.get_dag_details` fails if `DAG Run Timeout` is `None` HOT 2
- Not possible to trigger dag run HOT 3
- Basic authentication stopped working in 2.5.0 HOT 8
- Airflow Python Client 2.6.0rc1 fails with invalid type variable `execution_timeout` on get_tasks HOT 1
- Airflow Python Client 2.6.0rc2 fails with read-only dag_id attribute on post_dag_run HOT 7
- Draft release announcement in the release guide HOT 1
- Airflow Python Client 2.6.2rc1 "get_tasks" errors out with execution_timeout cannot be None HOT 5
- How Create Users with role Admin? HOT 5
- [TaskInstanceApi.get_task_instances] airflow_client.client.exceptions.ApiTypeError: Invalid type for variable 'trigger' HOT 2
- TaskInstances- "get instance batch" is getting timeout after 1 minute, status code- 504 (~1000 records) HOT 4
- The logical date parameter for DAGRun is incorrect HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from airflow-client-python.