Git Product home page Git Product logo

camicb / bigquery-utils Goto Github PK

View Code? Open in Web Editor NEW

This project forked from googlecloudplatform/bigquery-utils

0.0 0.0 0.0 22.71 MB

Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.

Home Page: https://cloud.google.com/bigquery/

License: Apache License 2.0

Shell 2.12% Python 15.30% Kotlin 10.45% Java 55.58% HTML 0.28% JavaScript 0.31% TypeScript 4.61% Starlark 1.52% C++ 8.53% Dockerfile 0.11% HCL 1.18%

bigquery-utils's Introduction

BigQuery Utils

BigQuery is a serverless, highly-scalable, and cost-effective cloud data warehouse with an in-memory BI Engine and machine learning built in. This repository provides useful utilities to assist you in migration and usage of BigQuery.

Open in Cloud Shell

Getting Started

This repository is broken up into:

  • Dashboards - Pre-built dashboards for common use cases
  • Performance Testing - Examples for doing performance testing
    • JMeter - Examples for using JMeter to test BigQuery performance
  • Scripts - Python, Shell, & SQL scripts
    • billing - Example queries over the GCP billing export
  • Stored Procedures - Example stored procedures
  • Tools - Custom tooling for working with BigQuery
  • UDFs - User-defined functions for common usage as well as migration
  • Views - Views over system tables such as audit logs or the INFORMATION_SCHEMA
    • query_audit - View to simplify querying the audit logs which can be used to power dashboards (example).

Public UDFs

For more information on UDFs and using those provided in the repository with BigQuery, see the README in the udfs folder.

Contributing

See the contributing instructions to get started contributing.

To contribute UDFs to this repository, see the instructions in the udfs folder.

License

All solutions within this repository are provided under the Apache 2.0 license. Please see the LICENSE file for more detailed terms and conditions.

Disclaimer

This repository and its contents are not an official Google Product.

bigquery-utils's People

Contributors

apstndb avatar christippett avatar creativitry avatar danieldeleo avatar epishova avatar fhoffa avatar freedomofnet avatar hashkanna avatar jrossthomson avatar kardiff18 avatar kcibul avatar krishsuchdev avatar lakshmanok avatar larchiu avatar mingen-pan avatar namratashah5 avatar neemay avatar noah-kuo avatar oapa avatar ota2000 avatar pdunn avatar phillcoletti avatar ryanmcdowell avatar salsferrazza avatar snackmgmg avatar spoiledhua avatar stankiewicz avatar vicenteg avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.