Comments (4)
Thanks for the report, will investigate.
from dbt-databricks.
Can you validate, do you have this same problem with 1.7.3? I think I know the cause, but getting that additional data point would help significantly. I'm pretty sure this is related to changes we had to make in 1.7.0 due to catalog and schema becoming non-optional on Credentials, so if that is the issue (in which it would also repro on 1.7.3), the fix might be a little involved.
from dbt-databricks.
@benc-db Unfortunately it looks like DBT Cloud only let's me select the major version and won't let me specify a minor version. Not seeing anything in the docs that I can use to override that.
We have a workaround in place now by specifying the catalog explicitly, but may want to make sure that this scenario is noted in the upgrade notes.
Also, I see 1.7.4 of the dbt-databricks releases is marked pre-release now, but looks like DBT Cloud is still pulling it in. Not sure if there is something required between Databricks and DBT to coordinate rollback items like this.
From triggering a run just now to confirm:
16:49:13 Registered adapter: databricks=1.7.4
from dbt-databricks.
Yeah, unfortunately there is required coordination. 1.7.4 has been pulled because it does not play nicely with cold-starting non-serverless SQL Warehouses. Working on fixing that at high priority so that next week dbt Cloud can pick up a good version.
from dbt-databricks.
Related Issues (20)
- SUPER SLOW dbt run -m model_name HOT 7
- run_query doesn't support array inside named_struct
- Materialized views & streaming tables don't support redefinition without dropping the full table HOT 2
- OAuth token caching fails on Windows 11 laptop HOT 1
- When using the Incremental Append Strategy, the newly added columns in SQL are not being added. HOT 2
- Databricks workflow with SQL Warehouse Pro crashes with http error 503 with version 1.7.4 HOT 21
- Respect profile schema when creating `__dbt_tmp` views HOT 3
- Running dbt-databricks on a job cluster
- Expecting all purpose cluster stop be utilised when configured job cluster detail HOT 3
- Creating materialized views do not set table properties HOT 3
- Wrong command for dropping Materialized Views HOT 3
- When a column is removed, the incremental schema change ignore option fails to function and results in a failure. HOT 1
- [BUG] REDIRCT_URL mismatched with Databricks Cloud OAuth Application HOT 10
- DBT python model passing date variables with different data types HOT 3
- The tblproperties are not applied when using Python Model to create a table HOT 1
- Migrate to using decoupled new decoupled core/adapters architecture HOT 1
- Python Model on Job Cluster HOT 5
- Access of Missing node_relation Attribute Causes dbt-core Hang
- Not all columns populated on column addition HOT 23
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dbt-databricks.