Comments (4)
harshthakkar01
commented on July 24, 2024
Hi,
This seems to be a limitation with terraform/gcp and there might not be an easy way to make it unique. This will need more investigation on whether creating google_service_networking_connection out of the SQL module into VPC module would be a better way or not. Since the SQL module is community experimental, we cannot make any specific commitment about timeline.
from hpc-toolkit.
github-actions
commented on July 24, 2024
This issue is stale because it has been open for 30 days with no activity.
from hpc-toolkit.
cboneti
commented on July 24, 2024
Hi Eimantas,
On the PR 2397 I propose to decouple the configuration of Private Service Access from the Cloud SQL creation. This would allow you to configure it once (for the lifetime of the VPC) and then use it across multiple clusters in that VPC, which I believe addresses your key concern here.
With this change, the following blueprint is valid (as an example):
blueprint_name: two-clusters
vars:
project_id: hpc-toolkit-demo
deployment_name: clstr2
region: us-east1
zone: us-east1-b
enable_reconfigure: True
enable_cleanup_compute: False
enable_cleanup_subscriptions: True
enable_bigquery_load: True
instance_image_custom: True
deployment_groups:
- group: net
modules:
- source: modules/network/vpc
id: hpc_network
- source: ./community/modules/network/private-service-access
id: ps-connect
use: [ hpc_network ]
- group: cluster1
modules:
- source: community/modules/compute/schedmd-slurm-gcp-v5-partition
kind: terraform
id: c1partition_0
use:
- c1partition_0-group
- hpc_network
settings:
partition_name: c1batch
enable_placement: False
exclusive: False
- source: community/modules/compute/schedmd-slurm-gcp-v5-node-group
id: c1partition_0-group
use:
settings:
enable_smt: False
machine_type: c2-standard-60
node_count_dynamic_max: 4
node_count_static: 0
disk_size_gb: 50
disk_type: pd-standard
- source: ./community/modules/database/slurm-cloudsql-federation
kind: terraform
id: c1slurm-sql
use: [hpc_network, ps-connect]
settings:
sql_instance_name: sql-cluster-1
tier: "db-g1-small"
- source: community/modules/scheduler/schedmd-slurm-gcp-v5-controller
kind: terraform
id: c1slurm_controller
settings:
cloud_parameters:
resume_rate: 0
resume_timeout: 500
suspend_rate: 0
suspend_timeout: 300
no_comma_params: false
machine_type: n2-standard-2
disk_type: pd-standard
disk_size_gb: 50
slurm_cluster_name: cluster1
use:
- hpc_network
- c1partition_0
- c1slurm-sql
- source: community/modules/scheduler/schedmd-slurm-gcp-v5-login
kind: terraform
id: c1slurm_login
use: [c1slurm_controller, hpc_network]
settings:
num_instances: 1
machine_type: n2-standard-2
disk_type: pd-standard
disk_size_gb: 50
- group: cluster2
modules:
- source: community/modules/compute/schedmd-slurm-gcp-v5-partition
kind: terraform
id: c2partition_0
use: [c2partition_0-group, hpc_network]
settings:
partition_name: c2batch
enable_placement: False
exclusive: False
- source: community/modules/compute/schedmd-slurm-gcp-v5-node-group
id: c2partition_0-group
settings:
enable_smt: False
machine_type: c2-standard-60
node_count_dynamic_max: 4
node_count_static: 0
disk_size_gb: 50
disk_type: pd-standard
- source: ./community/modules/database/slurm-cloudsql-federation
kind: terraform
id: c2slurm-sql
use: [hpc_network, ps-connect]
settings:
sql_instance_name: sql-cluster-2
tier: "db-g1-small"
- source: community/modules/scheduler/schedmd-slurm-gcp-v5-controller
kind: terraform
id: c2slurm_controller
use: [hpc_network, c2partition_0, c2slurm-sql]
settings:
cloud_parameters:
resume_rate: 0
resume_timeout: 500
suspend_rate: 0
suspend_timeout: 300
no_comma_params: false
machine_type: n2-standard-2
disk_type: pd-standard
disk_size_gb: 50
slurm_cluster_name: cluster2
- source: community/modules/scheduler/schedmd-slurm-gcp-v5-login
kind: terraform
id: c2slurm_login
use: [c2slurm_controller, hpc_network]
settings:
num_instances: 1
machine_type: n2-standard-2
disk_type: pd-standard
disk_size_gb: 50
Please note that the CloudSQL Federation does not really need to receive ps-connect as it is only used to inform the terraform dependency graph and prevent the attempt to create the Cloud SQL instance before private access is configured.
I would invite you to try this out and tell me if this fix the problem.
from hpc-toolkit.
cboneti
commented on July 24, 2024
Folks, this was now merged to develop. I will close this for now.
from hpc-toolkit.
Related Issues (20)
- How to use image-builder.yaml to install a docker image to template VM HOT 31
- SLURM 1.20 deployed and having node creation error HOT 40
- Slurm setup fails in deployed blueprint - possible error getting metadata HOT 7
- HPC toolkit no longer works with a2 instances HOT 6
- Partition a208 misconfigured in hpc-interprise-slurm.yaml HOT 4
- Update ml-slurm blueprint to use updated base image for schedmd debian 11 HOT 1
- Unable to dynamically modify the number of nodes in a slurm cluster HOT 2
- Slurm nodes with hybrid controller module unable to configure correctly HOT 2
- error when use packer to build image in ml-slurm HOT 2
- Unable to configure Slurm due to failure to mount filestore HOT 5
- Feature request: support `hashicorp/google` and `hashicorp/google-beta` v5
- ERROR: failed to sync instances when issuing `scontrol reboot` HOT 4
- Example of startup script with cluster without vm-instance? HOT 2
- Broken link HOT 1
- PMIx MPI support in Slurm HOT 16
- IP space of [gcp project subnet] is exhausted when deploying a GCP Slurm cluster HOT 2
- Packer custom image does not use specified service account email. HOT 3
- Upgrade to Ops Agent fails HOT 6
- HTCondor tutorial: add cloudresourcemanager.googleapis.com to the list of services to enable HOT 8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hpc-toolkit.