Comments (3)
I have a lot of similar cases. It would be super helpful to have this feature implemented
from kestra.
Update: This will be complex to implement (not a quick win) since this new task will not be able to remove the outputs of other tasks unless we change the executor implementation to make it work.
Additionally, for each output to remove, we'll need to:
- Remove it from internal storage if it's a file
- Remove it from the DB if it's an object (not a file)
- Remove the metadata for that output in the backend so that removed outputs are not displayed in the Outputs tab.
from kestra.
we discussed internally and selecting specific outputs to delete is not technically feasible at this time
the io.kestra.plugin.core.storage.PurgeCurrentExecutionFiles
is the best solution we can provide atm - it will allow to purge all execution's outputs, which can be done as the last task in a flow
from kestra.
Related Issues (20)
- Add a namespace column to the Flows tab in the Namespace page to account for child namespaces
- [Epic] Improve error handling
- [Epic] Handle issues that can make the application crash
- Ease flow dependancy declaration HOT 1
- Add Execution history to the Overview tab (e.g. as a Timeline view with states the Execution went through)
- [Epic] Capture outputs generated before a task run fails i.e. store Outputs before marking the task run as Failed
- [Epic] Improve plugin docs
- File Upload Endpoint for Kestra's Internal Storage HOT 1
- Add a lightweight kestra CLI
- Add a Supabase plugin HOT 2
- Ability to process incoming webhooks with large JSON payload HOT 3
- KV json validation
- Add a Concurrency tab on the Flow page allowing to see RUNNING and QUEUED executions
- Setting keystore value from Variables HOT 2
- Remove the disabled flag from the Flow source code — this should be API-only toggle/setting for the flow
- Vanilla instance serves Dashboard page instead of Welcome Page HOT 1
- Flaky tests
- Remove the generation of the latest-full tag
- Custom Blueprints page generates internal server error
- namespace files overwritten with code of a different namespace file
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kestra.