Topic: data-warehouse Goto Github

👇 Here are 464 public repositories matching this topic...

alanchn31 / data-engineering-projects
data-warehouse,Personal Data Engineering Projects
User: alanchn31
data-lake ingest-data data-engineering data-warehouse cassandra aws-redshift mongodb scrapy spark airflow

anna-geller / prefect-streaming
data-warehouse,Example project demonstrating deployment patterns for real-time streaming workflows with Prefect 2.0
User: anna-geller
automation aws data data-engineering dataflow dataflow-ops ecs-fargate engineering prefect real-time

appdynamics / appdynamics.dexter
data-warehouse,Turn your APM data store into a Data Warehouse with advanced reporting, including entities, configuration, metrics, flowmaps, events, snapshots and call graph flame graphs
Organization: appdynamics
Home Page: https://www.appdynamics.com/community/exchange/extension/appdynamics-dexter-data-extraction-enhanced-reporting/
appdynamics flamegraph apm data-warehouse reporting dotnet dotnet-core metrics callgraph snapshot appdynamics-dexter

beneath-hq / beneath
data-warehouse,Beneath is a serverless real-time data platform ⚡️
Organization: beneath-hq
Home Page: https://beneath.dev
dataops mlops data-science data-engineering data-pipelines developer-tools data-warehouse streaming etl analytics

blankerl / dxy-covid-19-data
data-warehouse,2019新型冠状病毒疫情时间序列数据仓库 | COVID-19/2019-nCoV Infection Time Series Data Warehouse
User: blankerl
Home Page: https://lab.isaaclin.cn/nCoV/
2019-ncov data-warehouse

canner / vulcan-sql
data-warehouse,Data API Framework for AI Agents and Data Apps
Organization: canner
Home Page: https://vulcansql.com
api-builder data-lake data-warehouse database sql analytics reporting spreadsheet bigquery duckdb

canner / wren-engine
data-warehouse,Wren Engine is the backbone of the semantic layer - The semantic engine for LLMs; bringing business context to LLMs.
Organization: canner
Home Page: https://getwren.ai
business-intelligence data data-analysis data-analytics data-lake data-warehouse sql semantic semantic-layer llm

cloudberrydb / cloudberrydb
data-warehouse,Cloudberry Database - Next generation unified database for Analytics and AI
Organization: cloudberrydb
Home Page: https://cloudberrydb.org/
database database-management data-analysis data-warehouse olap postgresql postgresql-database sql ai cloudberrydb

cloudera / hue
data-warehouse,Open source SQL Query Assistant service for Databases/Warehouses
Organization: cloudera
Home Page: https://cloudera.com
sql sql-editor databases data-warehouse query-editor sql-assistant autocomplete compose

dalenewman / transformalize
data-warehouse,Configurable Extract, Transform, and Load
User: dalenewman
etl etl-framework denormalize elasticsearch solr sql-server mysql postgresql sqlce sqlite

data-engineering-community / data-engineering-project-template
data-warehouse,This is a template you can use for your next data engineering portfolio project.
Organization: data-engineering-community
Home Page: https://dataengineering.wiki
data data-engineering data-warehouse etl etl-pipeline python sql

databrewery / cubes
data-warehouse,[NOT MAINTAINED] Light-weight Python OLAP framework for multi-dimensional data analysis
Organization: databrewery
Home Page: http://cubes.databrewery.org
olap data data-warehouse sql multidimensional-analysis cube data-analysis

dimgold / etl_with_python
data-warehouse,ETL with Python - Taught at DWH course 2017 (TAU)
User: dimgold
petl mysql python jupyter-notebook etl data-warehouse data-base mysqldb extract-transform-load csv

dlt-hub / dlt
data-warehouse,data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
Organization: dlt-hub
Home Page: https://dlthub.com/docs
data python data-engineering data-lake data-loading data-warehouse elt extract load transform

domainmod / domainmod
data-warehouse,DomainMOD is an open source application written in PHP & MySQL used to manage your domains and other internet assets in a central location. DomainMOD also includes a Data Warehouse framework that allows you to import your web server data so that you can view, export, and report on your live data.
Organization: domainmod
Home Page: https://domainmod.org
php mysql domains whm cpanel data-warehouse hacktoberfest mariadb

elementary-data / elementary
data-warehouse,The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
Organization: elementary-data
Home Page: https://www.elementary-data.com/
data-lineage data-governance data-warehouse snowflake bigquery data-analysis data-pipelines data-pipeline lineage data-reliability

fozan-talat / divvy-bikeshare-de-project
data-warehouse,An end-to-end data pipeline which extracts divvy bikeshare data from web loads it into data lake and datawarehouse transforms it using dbt and finally , a dashboard to visualize the data using looker studio, the pipeline is orchestrated using prefect
User: fozan-talat
bigquery dbt divvy-bikes gcp gcs-bucket google-cloud-platform google-cloud-storage looker-studio prefect python

gclunies / reflekt
data-warehouse,Define, govern, and model event data for warehouse-first product analytics.
User: gclunies
avo customer-data-platform data-modeling data-quality data-warehouse dbt dbt-package events governance product-analytics

getmetamapper / metamapper
data-warehouse,Metamapper is a data discovery and documentation platform for improving how teams understand and interact with their data.
Organization: getmetamapper
Home Page: https://www.metamapper.io
metamapper data-catalog data-discovery schema-inspection data-warehouse python django data-curation metadata

gokumohandas / data-engineering
data-warehouse,Construct a modern data stack and orchestration the workflows to create high quality data for analytics and ML applications.
User: gokumohandas
data-engineering etl machine-learning mlops orchestration airflow data-warehouse dbt

google / space
data-warehouse,Unified storage framework for the entire machine learning lifecycle
Organization: google
dataset lakehouse machine-learning mlops olap ray tensorflow tensorflow-dataset apache-arrow apache-parquet

googlecloudplatform / bigquery-utils
data-warehouse,Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.
Organization: googlecloudplatform
Home Page: https://cloud.google.com/bigquery/
bigquery google-cloud-platform data-warehouse sql utilities

greenplum-db / gpdb
data-warehouse,Greenplum Database - Massively Parallel PostgreSQL for Analytics. An open-source massively parallel data platform for analytics, machine learning and AI.
Organization: greenplum-db
Home Page: http://greenplum.org
greenplum-database gpdb mpp postgresql data-warehouse database htap analytics

hydradatabase / hydra
data-warehouse,Hydra: Column-oriented Postgres. Add scalable analytics to your project in minutes.
Organization: hydradatabase
Home Page: https://www.hydra.so
data-warehouse datawarehouse postgres postgresql postgresql-extension

iam-mhaseeb / skytrax-data-warehouse
data-warehouse,A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for cloud data warehouse and Metabase to serve the needs of data visualizations such as analytical dashboards.
User: iam-mhaseeb
python python3 database data-visualization data-analysis data-warehouse data-warehousing redshift airflow docker sql data-orchestration data-analytics s3 s3-bucket metabase data-engineering data-cleaning data-processing

iiasa / ixmp
data-warehouse,The ix modeling platform for integrated and cross-cutting scenario analysis
Organization: iiasa
Home Page: https://docs.messageix.org/ixmp
integrated-assessment energy-system modeling-tool data-warehouse open-source

intermine / intermine
data-warehouse,A powerful open source data warehouse system
Organization: intermine
Home Page: http://intermine.org
data-warehouse java tomcat genomics open-source opensource lgplv3 postgresql clojure clojurescript biology tomcat8 webservices api perl python bioinformatics genetics data-visualisation data-visualization

izhangzhihao / real-time-data-warehouse
data-warehouse,Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi
User: izhangzhihao
flink data-warehouse real-time-data-warehouse data-warehousing flink-sql debezium kafka elasticsearch delta-lake cdc

massstreetanalytics / etl-framework
data-warehouse,A framework for moving data into a data warehouse.
Organization: massstreetanalytics
Home Page: http://www.datawarehouseetlframework.com/
etl python sqlserver sql etl-framework etl-pipeline etl-components data-warehouse

materializeinc / materialize
data-warehouse,The data warehouse for operational workloads.
Organization: materializeinc
Home Page: https://materialize.com
rust database sql streaming kafka distributed-systems postgresql-dialect materialized-view stream-processing postgresql

multiwoven / multiwoven
data-warehouse,🔥🔥🔥 Open Source Hightouch, Census, and RudderStack Alternative
Organization: multiwoven
Home Page: https://multiwoven.com
data-engineering reverse-etl data-pipeline data-activation etl react ruby self-hosted open-source dbt bigquery data-warehouse databricks postresql redshift snowflake typescript hacktoberfest cdp customer-data-platform

newtendermint / awesome-bigdata
data-warehouse,A curated list of awesome big data frameworks, ressources and other awesomeness.
User: newtendermint
Home Page: https://github.com/onurakpolat/awesome-bigdata
awesome bigdata data-warehouse data-analytics data-visualization data-stream database data-science data awesome-list

pracdata / awesome-open-source-data-engineering
data-warehouse,A curated list of open source tools used in analytical stacks and data engineering ecosystem
Organization: pracdata
awesome awesome-list data-analytics data-engineering data-platform database self-hosted mlops data-storage data

raystack / optimus
data-warehouse,Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
Organization: raystack
Home Page: https://raystack.github.io/optimus
airflow etl workflows automation golang bigquery data-warehouse analytics data-modelling analytics-engineering

rello / analytics
data-warehouse,Analytics - Open source data warehouse and reporting for Nextcloud
User: rello
nextcloud analytics visualization data data-warehouse datasources

rudderlabs / rudder-server
data-warehouse,Privacy and Security focused Segment-alternative, in Golang and React
Organization: rudderlabs
Home Page: https://www.rudderstack.com/
golang hybrid-cloud privacy security warehouse-management data-warehouse rudderstack customer-data customer-data-pipeline customer-data-platform

san089 / udacity-data-engineering-projects
data-warehouse,Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
User: san089
data data-engineering data-engineering-pipeline etl-pipeline cassandra-database postgresql-database data-modeling data-warehouse data-lake airflow

sap-samples / datasphere-content
data-warehouse,Use sample content to explorer SAP Datasphere. The downloads contain sample data as CSV files, but could also include model / metadata information. See the README files for details.
Organization: sap-samples
sap-hana data-warehouse cloud sample sample-code sap-datasphere

scottpersinger / pgwarehouse
data-warehouse,Easily sync your Postgres database to a Snowflake, ClickHouse, or DuckDB warehouse.
User: scottpersinger
analytics clickhouse data-warehouse postgres postgresql snowflake synchronization warehouse

scratchdata / scratchdata
data-warehouse,Scratch is a swiss army knife for big data.
Organization: scratchdata
Home Page: https://www.scratchdata.com
clickhouse data-warehouse hacktoberfest olap bigquery redshift snowflake duckdb motherduck

sharpdata / sharpetl
data-warehouse,Write ETL using your favorite SQL dialects
Organization: sharpdata
Home Page: https://sharpdata.github.io/SharpETL/
bigdata data-warehouse datawarehouse etl etl-framework flink flink-sql hive paimon scala spark spark-sql sql

tensorbase / tensorbase
data-warehouse,TensorBase is a new big data warehousing with modern efforts.
Organization: tensorbase
Home Page: https://tensorbase.io/
analytics bigdata data data-infrastructure data-warehouse database engineering high-performance infrastructure modern rust rust-lang warehouse

titan-systems / titan
data-warehouse,Snowflake infrastructure-as-code. Provision environments, automate deploys, CI/CD. Manage RBAC, users, roles, and data access. Declarative Python Resource API. Change Management tool for the Snowflake data warehouse.
Organization: titan-systems
data-engineering data-warehouse snowflake data-governance dataops secops compliance-as-code devops rbac

tuva-health / tuva
data-warehouse,Main repo including core data model, data marts, reference data, terminology, and the clinical concept library
Organization: tuva-health
Home Page: https://thetuvaproject.com/
analytics-engineering bigquery data-analytics data-governance data-lineage data-pipelines data-warehouse dbt dbt-packages healthcare

ubisoft / mobydq
data-warehouse,:whale: Tool to automate data quality checks on data pipelines
Organization: ubisoft
Home Page: https://ubisoft.github.io/mobydq/
data-quality data-pipeline data-warehouse big-data data-quality-checks data-quality-monitoring

umer7 / data-warehouse-concepts-design-and-data-integration
data-warehouse, Repo for Data Warehouse Concepts, Design, and Data Integration by University of Colorado System (coursera)(Notes,Assignments, quiz and research papers)
User: umer7
datawarehouse pentaho data-integration data-warehouse oracle

unytics / airbyte_serverless
data-warehouse,Airbyte made simple (no UI, no database, no cluster)
User: unytics
airbyte bigquery data-warehouse elt etl data data-analysis data-engineering pipeline

unytics / bigfunctions
data-warehouse,Supercharge BigQuery with BigFunctions
User: unytics
Home Page: https://unytics.io/bigfunctions/
bigquery data data-analytics data-visualization data-warehouse data-engineering

vmware / versatile-data-kit
data-warehouse,One framework to develop, deploy and operate data workflows with Python and SQL.
Organization: vmware
data-science data-engineering sql trino data-lineage etl elt data-pipelines data-engineer data-warehouse

wathon / data_engineering_with_python-track-datacamp
data-warehouse,Data Engineer with Python lecture notes from #datacamp.
User: wathon
data-engineering python datacamp-track shell sql scala aws-boto pyspark spark-sql mongodb