Git Product home page Git Product logo

de_zoomcamp_week4_dbt's Introduction

Welcome to your new dbt project!

How to run this project

About the project

This project is based in dbt starter project (generated by running dbt init) Try running the following commands:

  • dbt run
  • dbt test

A project includes the following files:

  • dbt_project.yml: file used to configure the dbt project. If you are using dbt locally, make sure the profile here matches the one setup during installation in ~/.dbt/profiles.yml
  • *.yml files under folders models, data, macros: documentation files
  • csv files in the data folder: these will be our sources, files described above
  • Files inside folder models: The sql files contain the scripts to run our models, this will cover staging, core and a datamarts models. At the end, these models will follow this structure:

image

Workflow

image

Execution

After having installed the required tools and cloning this repo, execute the following commnads:

  1. Change into the project's directory from the command line: $ cd [..]/taxi_rides_ny
  2. Load the CSVs into the database. This materializes the CSVs as tables in your target schema: $ dbt seed
  3. Run the models: $ dbt run
  4. Test your data: $ dbt test Alternative: use $ dbt build to execute with one command the 3 steps above together
  5. Generate documentation for the project: $ dbt docs generate
  6. View the documentation for the project, this step should open the documentation page on a webserver, but it can also be accessed from http://localhost:8080 : $ dbt docs serve

dbt resources:

  • Learn more about dbt in the docs
  • Check out Discourse for commonly asked questions and answers
  • Join the chat on Slack for live discussions and support
  • Find dbt events near you
  • Check out the blog for the latest news on dbt's development and best practices

de_zoomcamp_week4_dbt's People

Contributors

elvas avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.