Comments (5)
@caoilte Thank you for pointing this out, after trying to replicate your issue i'm wondering if you could give me a little more context? or additional config information in your projects.yml that might be pointing to a failing cause as we haven't been able to make capitals in either file name of a csv seed file or yml schema cause failure.
from dbt-bigquery.
Hi @McKnight-42 ,
Our steps were,
- create a GBQ dataset (as part of a model) with a capitalised name (eg "caoilte_Bananas_raw"). This worked fine for a few weeks as a source.
- create a seed which was assigned to dataset "caoilte_Bananas_raw". This failed with the above.
We never had a problem with capitals in the file names. It was always the dataset that it was assigned to which caused a problem.
However, we've also since banned capitalised letters in our dataset and table names to de-risk ourselves. So if you're unable to reproduce we won't be greatly inconvenienced at this point.
from dbt-bigquery.
@caoilte thank you for the furthered context so far we have tried the following please let me know if I've missed anything.
- created a seed csv file named test.csv and tried it locally with a dbt seed which worked
- changed name to Test.csv and tried again which also worked.
- set up a seed configuration in project.yml for Test which also passed:
dbt_project.yml
seeds:
+schema: Test
dbt seed
1 of 1 START seed file dbt_user_Test.test................................... [RUN]
1 of 1 OK loaded seed file dbt_user_Test.test............................... [INSERT 1 in 3.44s]
on pass this also added the dataset dbt_user_Test
to my bigquery project.
4. made sure file name and configure name were different which also worked with dbt seed
5. also tried creating a federated table and added it to big query as a table in a dataset and using it as a source for a seed which did not get picked up as the seed file itself wasn't a csv file. (dbt seed didn't fail here just didn't look at the .sql file)
from dbt-bigquery.
Yeah. I'm struggling to reproduce in a fresh project. Maybe there's something weird about our macro to use part of our resource paths as dataset names. happy to close.
from dbt-bigquery.
@caoilte alright, thank you for following up with us, I will close this issue for now if it or something similar comes up again please reach out.
from dbt-bigquery.
Related Issues (20)
- [Bug] many timeouts with `priority: interactive` config HOT 7
- [Bug] Incremental models don't update new elements in struct column
- [Regression] `docs generate` raises error when querying dataset with BQ ML models HOT 1
- dbt bigquery 1.3 Flake8 is failing a mypy check
- [Bug] Cannot parse partition config when specified in property YAML file HOT 2
- [Test] testing workflow
- [Tech Debt] Run all python model tests in sequence across runs
- [Feature] Retrieving and using table/column descriptions from BigQuery
- [Bug] Using `grants` on `materialized_view` raises an error
- [Bug] Build verification is failing HOT 1
- [Bug] Updating partitioning/clustering on a table self referencing itself will fail and delete the table
- [Bug] Dataproc (Python models) do not retry polling on 5xx errors HOT 1
- [Bug] Data mix-up in struct with enforced contracts
- [Bug] Nested record field is not quoted and causes build error when contract enforced enabled. HOT 1
- [Bug] `dbt show` integration test using JSON struct is failing for `1.8`
- Update the build check workflow
- [Bug] spark_catalog requires a single-part namespace in dbt python incremental model
- [Bug] Jobs timing out early regardless of job_execution_timeout_seconds
- [Bug] Bug in partitions_match method causing tables to be dropped for full refresh even though partitioning spec did not change
- [Bug] is_incremental always return False when use Project Number instead of Project ID HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dbt-bigquery.