Comments (3)
@ssassi I just read through #41— that's exactly the same use case I have, I want to exclude _airbyte_raw
tables. I'd be happy to contribute here, but I'm not too familiar with the codebase or setup. Would you be able to meet and chat through the process? I haven't contributed to an open source project before.
from dbt-coves.
@mattppal thank you for contributing.
We've recently added select-relations
and exclude-relations
to generate sources
command. They let you choose or ignore relations (tables) from being subject of generation.
Keep in mind filtering in generate sources
and generate properties
works differently:
- generate properties works with
select
,exclude
andselector
: this filtering strategies work exactly as dbt ls do. In fact, asgenerate properties
works with dbt's local files, these flags are passed directly to a dbt subprocess. - generate sources works with the two most recent flags I stated above and, instead of working locally, it goes through your Adapter to the database-schema combination passed to the command.
Regards
from dbt-coves.
Love it! Thanks
from dbt-coves.
Related Issues (20)
- [BUG] Generate Sources in BigQuery with same table name (different cases) HOT 1
- Run pre-commit checks on CI HOT 1
- [BUG] Updating existing source yml removes pre-existing quotes from description HOT 7
- [BUG] ❌ 'bool' object has no attribute 'parent' after running `dbt-coves setup all` HOT 3
- Feature request: For automation, add more defaults (and ideally, an `all` option for some) for `generate sources` HOT 3
- Feature Request: Snowflake: Multithreading for performance? HOT 5
- Question: Should `generate sources` remove sources/staging models that are no longer in the database? HOT 2
- [BUG] (question) `generate sources` doesn't pick up new columns HOT 1
- Request:`generate sources`: Quote columns that use SQL keywords (such as `GROUP`) HOT 3
- [feat] Setup task expansion to cover lifecycle of dbt-coves vendored components
- Feature: Generate docs.md files with link to schema.yml columns
- Feature: Get source descriptions from OpenAPI specifications
- [BUG] Arrays are casted as string or record HOT 4
- [BUG] Unable to install v1.3 via PyPI/pip HOT 2
- Feature request: `generate sources` "update" mode also update staging models (rather than overwrite or leave unchanged) HOT 2
- Allow custom model naming HOT 1
- [BUG] dbt-coves fails to detect columns in schema HOT 8
- Option to not generate source.yml by default HOT 1
- Support for dbt 1.5 HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dbt-coves.