Comments (4)
Hi @the4thamigo-uk, AssetGraph
(which as you note is a private API) is under very heavy surgery right now, so it's not surprising you're seeing problems. There is a fresh batch of changes that will roll out next week that includes performing "normalization" on the assets defs passed in to the AssetGraph
, which will create stub defs for any referenced asset keys otherwise lacking a def-- I'm guessing that is going to fix your problem here, so my advice is to try upgrading to next week's release.
Let's leave the issue open until then and revisit if that doesn't work.
there doesn't seem to be a publicly-exposed way to request the stale status of a given asset/partition.
That's a good point, the closest thing we have is the GQL API. I'm going to put adding a Python API for this in our internal queue.
from dagster.
Thanks @smackesey ... sounds good...
from dagster.
Looks like the 1.6.9 release might have fixed this, was that expected?
from dagster.
Looks like the 1.6.9 release might have fixed this, was that expected?
It wouldn't be surprising, since AssetGraph
is under heavy surgery. Since it's a private API I can't recall exactly which changes are falling into which release.
from dagster.
Related Issues (20)
- DbtCliEventMessage Unable to Handle Sources HOT 2
- Emit dynamic partition entries when testing sensors in a branch deployment
- Allow specifying custom base images from public registries for PEX deploys
- JS errors on Google Chrome when displaying large number of assets in global lineage view. HOT 3
- Can't test asset that uses `asset_partition_key_for_input` HOT 2
- Code location versioning
- Dagster uses an implausible number of postgresql connections HOT 17
- [K8sRunLauncher] includeConfigInLaunchedRuns doesn't copy nodeSelector HOT 1
- Multipartitions with more than two dimensions HOT 2
- [UI] Keyboard shortcut or permanent button to reload code location HOT 2
- Ability to set a default compute kind
- Ability to re-materialize all assets that use a given IO Manager
- Some tagging of assets that can't be loaded by their IO manager
- Auto-Materialization is not working for a Dagster-native asset that depends on an external asset in Dagster >= 1.6.7
- AutoMaterialise splits partitioned and non-partitioned asset into separate jobs
- dagster-dbt - AutoMaterializeRule.skip_on_not_all_parents_updated should allow excluding sources
- LeaseLost Error in Azure Data Lake Storage Gen2 IO Manager During Step Output Handling
- Asset status per partition on job not displaying full asset name HOT 2
- Ability to block certain partitions/backfills from executing
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dagster.