- Create a Project
- Create a data-repo for the Project
- Create analysis pipeline
- Preview outputs
- Consume output using:
- Web Application
- API
- BI Tool
###Infrastrcture
- "AWS K8" infrastructure defined here is deployed on domain inkeystone.com
- You will need access to private keys if you wish to update deployed state - first go to the master branch and follow that readme.
- This deploys Kubernetes (k8) cluster (3 nodes: 1 master, 2 service) on top of a secure networking architecture
- This Infrastructure is managed by Terraform scripts and the current state is stored in
s3://inkeystone-com-state
:
- Networking:
/labroots.tfstate
- K8:
/labroots-kubernetes.tfstate
- Data:
/labroots.inkeystone.com/
- Access the Admin Dashbaord for the k8 cluster @
api.labroots.inkeystone.com
###Deployed Services (on the platform)
- Pachyderm: Data Lake with Versioning & Language Agnostic Analysis Pipelines
- State is stored in
s3://inkeystone-com-pachd
- Kubeflow (Model Management)
- Dremio (Data Virtualization)