Comments (2)
gofford
commented on June 1, 2024
2
To add to this I think there would be a lot of benefit to adding a documented example of how to properly write logs to stdout/stderr whilst also writing events to the event stream in the same process. This would allow users to write logs to storage and events to the database. It's not completely clear to me how this should be achieved with the dagster logging mechanisms at the moment.
from dagster.
AndreaGiardini
commented on June 1, 2024
1
@garethbrickman This should also be marked as "docs" rather than feature-request. The current recommendations for logging are inaccurate
from dagster.
Related Issues (20)
- `dagster-mlflow` tracking config not used from run_config when already configured in definitions HOT 2
- make pyright error
- Test Schedule "Open in Launchpad" not working HOT 2
- Incorrect return type of functions in load_assets_from_modules
- Auto-materialization of non-existing partitions
- dagster/max_runtime tag does not seem to work HOT 2
- Could not load job definition error "TypeError: unhashable type: 'list'" HOT 5
- Include Asset Description in the Dagster web-server search functionality
- Dagster Serverless Deploy not working when importing dbt project HOT 3
- Add `YearlyPartitionsDefinition` HOT 2
- Unexpected GraphQL error when deployed on AWS ECS HOT 1
- MLflow hook updates MLflow run state based on all op events, not the just the final op
- execute_in_process with FakeDatetimes do not work
- Number of assets are different in Dagster+ HOT 1
- Make it easier to define freshness checks for dbt models
- ImportError: cannot import name 'GenericAlias' from partially initialized module 'types' HOT 6
- Could not load job definition. dagster._check.CheckError: Invariant failed. Description: No metadata found for CacheableAssetsDefinition with unique_id airbyte / Using I/O Manager BigQuery
- `_get_infer_single_to_multi_dimension_deps_result` is to restrictive, can't handle identityMapped staticPartitionDefintions
- Freshness sensor does not run when assets are pending or failed HOT 1
- Table IO Managers should capture column schemas with appropriate metadata tag HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dagster.