Builder. Maker. Open source enthusiast.
Data Engineering | NLP | LLM | Computer Vision | Software Engineering
Reach me at: [email protected]
Builder. Maker. Open source enthusiast.
Data Engineering | NLP | LLM | Computer Vision | Software Engineering
Reach me at: [email protected]
tview provides a nice terminal UI to display data, which fits nicely into airflow-runner requirements.
Instead of displaying scrolling logs, it would be much nicer to display some view like k9s of currently executing jobs
We need the ability to override execution_date when triggering the dags. For that while sending data to the jobs need to be able to pass a new param in datetime format as per eod Date
{
"execution_date": "2022-01-22T00:00:00Z"
}
Add tests and integrate code coverage tool
We can extend config.yaml
to add a simple parameter that will control the number of jobs being triggered in parallel. As soon as any of the triggered jobs finishes, we can trigger another job from the same step.
Currently, we sleep for 10 seconds before retrying to check if triggered job (dag) has finished execution. This can be made into a parameter in config.yaml
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.