Git Product home page Git Product logo

quickstart-datalake-47lining's Introduction

quickstart-datalake-47lining

Data Lake Foundation on the AWS Cloud

This Quick Start deploys a data lake foundation that integrates Amazon Web Services (AWS) services such as Amazon Simple Storage Service (Amazon S3), Amazon Redshift, Amazon Kinesis, Amazon Athena, Amazon Elasticsearch Service (Amazon ES), and Amazon QuickSight.

The data lake foundation uses these AWS services to provide data submission, ingest processing, dataset management, data transformation, aggregation, and analysis, search, publishing, and visualization capabilities. Once this foundation is in place, you may choose to augment the data lake with ISV and SaaS tools.

The deployment also includes an optional wizard and a sample dataset that is loaded into Amazon Redshift and Kinesis streams to demonstrate data lake capabilities.

The AWS CloudFormation templates included with the Quick Start automate the following:

  • Deploying the data lake foundation into a new virtual private cloud (VPC)
  • Deploying the data lake foundation into an existing VPC in your AWS account

You can also use the AWS CloudFormation templates as a starting point for your own implementation.

Quick Start architecture for data lake foundation on AWS

For architectural details, best practices, step-by-step instructions, and customization options, see the deployment guide.

To post feedback, submit feature ideas, or report bugs, use the Issues section of this GitHub repo. If you'd like to submit code for this Quick Start, please review the AWS Quick Start Contributor's Kit.

quickstart-datalake-47lining's People

Contributors

aws-ia-ci avatar sshvans avatar mklew avatar tbulding avatar davmayd avatar handans avatar andrew-glenn avatar fp-47 avatar rniksch avatar susanjo avatar

Watchers

James Cloos avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.