Navigate to terraform-module-flink-cluster
, then run
terraform init
(terraform validate)
(terraform plan)
terraform apply --auto-approve
in /k8s-cluster
, then in /helm-charts
.
Then, in /Q-table
, run
docker build -f docker/Dockerfile -t scaling:vX .
kind load docker-image --name "flink-k8s-cluster" scaling:vX
aws ecr-public get-login-password --region us-east-1 --profile brown | docker login --username AWS --password-stdin public.ecr.aws
docker buildx build --platform linux/amd64 --build-arg FLINK_VERSION=1.17.1 -t public.ecr.aws/m5r4d3y5/flink-jobs:q-table-feb03-v2 -f docker/Dockerfile .
docker push public.ecr.aws/m5r4d3y5/flink-jobs:q-table-feb03-v2
and make sure image
in /Q-table/kubernetes/development.yaml
matches your most recent image tag.
To start the scaling pod in kubernetes, run
kubectl apply -f kubernetes/development.yaml
Then, to start the flink job, run the terraform commands again in terraform-module-flink-cluster/flink_job
.
To stop the scaling pod, run
kubectl delete -f kubernetes/development.yaml
To stop the flink job, run
terraform destroy --auto-approve
in flink-job
.
To stop the cluster, run the same command in helm-charts
and k8s-cluster
, respectively.