Note Each ansible role has a general and a specific Readme file. It is encouraged to read them before firing off

p.s: Start with the readme file of main setup playbook

• Create an Api on hetzner
• Create a server as terraform and ansible provisioner (Needless to say that ansible and terraform must be installed)
• Clone the project
• In modular_terraform folder create a terraform.tfvars
  • The file must contain the following variables
    • hcloud_token "APIKEY"
    • image_name = "ubuntu-22.04"
    • server_type = "cpx31"
    • location = "hel1"
• Run terraform init to create the required lock file
• Before firing off, run terraform plan to see if everything is alright
• Run terraform apply
• Go Drink a cup of coffe and come back in 10 minutes or so (Hopefully everything must be up and running by then (: )

• RGW IPs are not set on the domain automatically
• No custom dashboards
• No automation for scaling or maintenance
• No audit logging (to see when,who made what changes on the cluster)
• Terraform is limited to Hetzner
• Since there is no specific range for servers, public-network of mon, in on 0.0.0.0/0
  • Firewall policies minimize the risk
• Grafana datasource must be set manually http://IP_ADDRESS_:8428

• Run the following command for terraform to install dependencies and create the lock file

terraform init

• Run the following command and check if there are any problems with terraform

terraform plan

• Apply terraform modules and get started

terraform apply

• Check the storage capacity on OSDs

ceph -s
ceph orch host ls
ceph df

• Check if Mons are in quorum

ceph mon stat

• Check if Victoria_Metrics and Vmagent work

• Note

Check if all targets are scraped properly

• Check if vmalert works

• Note

Check if alerts are gouped properly

• Check if Grafana works

• Note

All dashboard are provisioned To add custom dashbaord on load, add it to /Ansible/roles/Victoria_Metrics/files/Grafana/provisioning/dashboards as a .json file. It would automatically be loaded to Grafana Just keep in mind that you have to also copy the dashbaord using ansible to the remote destination

• Check if Alert manager is working

• Note

Created some alerts to demonstrate The alerts are being routed to Slack/Gmail

• Creating a bucket

s3cmd --config=s3cfg mb s3://bucket

• Upload objects

s3cmd --config=scfg put 1G.bin s3://bucket

• To Clean up everything (including the nodes themselvs)

terraform destroy