Comments (3)
🤖
Hey @spacepirate0001, great to see you around here again! Hope you're navigating the vast seas of code without too much trouble.
Thank you for bringing this to our attention. The issue you're facing is due to the default download size limit of 2MB in Flyte. This limit is enforced to manage resource utilization and ensure optimal performance across the system. However, it can be configured through the Flyte system's settings.
Unfortunately, the .values.configuration.storage.limits.maxDownloadMBs
parameter cannot be added directly to the Flyte-binary chart values.yaml to configure the default download size limit in Flyte. The values.yaml
file for the Flyte Helm chart does not currently support a parameter for setting the maximum download size limit.
However, you can add custom configurations to Flyte by using the inline
field under configuration
in the values.yaml
file. This field allows you to specify additional configuration or overrides for Flyte, to be merged with the base configuration.
Here is an example of how you might add a custom configuration for maxDownloadMBs
:
configuration:
inline:
storage:
limits:
maxDownloadMBs: 100
Please note that this is just an example and the actual configuration might differ based on the Flyte's configuration system. You should refer to the Flyte documentation or source code to find the exact configuration parameters that you need.
In a similar issue, ContainerTask run error in copilot, the user managed to fix the issue by adding the same configuration.
I hope this helps! If you have any other questions or need further clarification, feel free to ask.
Sources
About Dosu
This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.
Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.
If you want to continue the conversation, start your reply with @dosu-bot.
from flyte.
Yes! I used inline to get around this for now but configuration should be included properly.
from flyte.
@spacepirate0001 , since you already diagnosed the problem and offered a solution, would you be willing to contribute? Tag me on the PR, I'll gladly review it!
from flyte.
Related Issues (20)
- [BUG] `PanderaTransformer::to_python_value()` seems to be returning an incorrect type HOT 2
- [BUG] flytectl upgrade is broken after moving to the monorepo HOT 2
- [BUG] Pin fsspec<2024.5.0 HOT 2
- [BUG] Namespace creation fails with default pod template HOT 5
- [BUG] flytectl demo start fails with "Error: malformed version" HOT 2
- [Docs] Clarify PodTemplate restrictions and behavior HOT 2
- [Docs] Prevent using mutable default arguments in flytesnacks HOT 1
- [Core feature] Replace `os.path` with `pathlib` for flytekit HOT 1
- Obfuscate sensitive data in TaskConfig HOT 4
- [BUG] Fix non thread safe token cache behavior HOT 1
- [Core feature] Flyteadmin SMPT email publisher HOT 1
- [BUG] rshift '>>' operator doesn't work properly with remoteEntities HOT 2
- [Core feature] Allow flytectl to set a targetExecutionCluster HOT 1
- [BUG] Boolean values within pydantic base model being casted to scalar value HOT 1
- [Housekeeping] Files used in `data_types_and_io.normalize_csv_file` and `data_types_and_io.download_and_normalize_csv_files` are no longer accessible HOT 6
- [Core feature] Default task resource behavior should apply for node level overrides HOT 3
- [Core feature] Update/register multiple launch plans with different inputs HOT 1
- [BUG] (Kubeflow) PyTorchPlugin sets Replicas to 0 casuing infinite loop HOT 3
- [BUG] regression: envFrom provided from pod template is discarded HOT 1
- [BUG] Relaunch workflow converts large numbers in array of structs to objects. HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from flyte.