I got error message while deploying kubo 0.0.4 on openstack.
Following is api worker/0 flanneld_ctl.stderr.log.
Error: client: etcd cluster is unavailable or misconfigured
error #0: dial tcp: lookup 9ce829f9-bebb-4b3d-8546-ad982f38920a.etcd.kubo-network.kubo.bosh on 192.168.17.12:53: no such host
My DNS status
worker/966fb1f2-fe36-4a1f-af3a-674310cf910d:/var/vcap/sys/log/flanneld# nc -v 192.168.17.12 53
Connection to 192.168.17.12 53 port [tcp/domain] succeeded!
My ETCD heath
etcd/9ce829f9-bebb-4b3d-8546-ad982f38920a:/var/vcap/jobs/etcd/bin# /var/vcap/packages/etcd/etcdctl cluster-health
member f7c77ad6832e05a9 is healthy: got healthy result from http://172.16.21.7:4001
cluster is healthy
Bosh deploy error log
'''
Director task 886116
Started preparing deployment > Preparing deployment. Done (00:00:01)
Started preparing package compilation > Finding packages to compile. Done (00:00:00)
Started compiling packages
Started compiling packages > cni/fb66deef2826ccd6c6c135dbc915094e6cef2ab6
Started compiling packages > flanneld/69e5913473152bb3a97fee5ad5f237cb6b3becba
Started compiling packages > etcdctl/35165b48a3100f6f0e4af03c211f913dcf0055b2
Started compiling packages > jq/a8a92d1eb93b806ff9e4f9e8daab4d0dec04b962
Started compiling packages > kubernetes/cc9d2c04acabe975800122fa0a5b1cd4c2a65bae
Done compiling packages > jq/a8a92d1eb93b806ff9e4f9e8daab4d0dec04b962 (00:01:12)
Started compiling packages > pid_utils/96db60d4d683939fd187297035544c340e75d9a4
Done compiling packages > flanneld/69e5913473152bb3a97fee5ad5f237cb6b3becba (00:01:12)
Done compiling packages > etcdctl/35165b48a3100f6f0e4af03c211f913dcf0055b2 (00:01:17)
Done compiling packages > pid_utils/96db60d4d683939fd187297035544c340e75d9a4 (00:00:05)
Done compiling packages > cni/fb66deef2826ccd6c6c135dbc915094e6cef2ab6 (00:01:20)
Done compiling packages > kubernetes/cc9d2c04acabe975800122fa0a5b1cd4c2a65bae (00:02:13)
Done compiling packages (00:02:13)
Started creating missing vms
Started creating missing vms > etcd/9ce829f9-bebb-4b3d-8546-ad982f38920a (0)
Started creating missing vms > master/e89abc82-a44f-45e3-9f86-4b50589ee288 (0)
Started creating missing vms > worker/966fb1f2-fe36-4a1f-af3a-674310cf910d (0). Done (00:00:55)
Done creating missing vms > master/e89abc82-a44f-45e3-9f86-4b50589ee288 (0) (00:00:57)
Done creating missing vms > etcd/9ce829f9-bebb-4b3d-8546-ad982f38920a (0) (00:00:58)
Done creating missing vms (00:00:58)
Started updating instance etcd > etcd/9ce829f9-bebb-4b3d-8546-ad982f38920a (0) (canary). Done (00:00:46)
Started updating instance master > master/e89abc82-a44f-45e3-9f86-4b50589ee288 (0) (canary). Done (00:00:56)
Started updating instance worker > worker/966fb1f2-fe36-4a1f-af3a-674310cf910d (0) (canary). Failed: 'worker/0 (966fb1f2-fe36-4a1f-af3a-674310cf910d)' is not running after update. Review logs for failed jobs: flanneld, docker, kubelet (00:11:14)
Error 400007: 'worker/0 (966fb1f2-fe36-4a1f-af3a-674310cf910d)' is not running after update. Review logs for failed jobs: flanneld, docker, kubelet
'''
job status
RSA 1024 bit CA certificates are loaded due to old openssl compatibility
Acting as user 'admin' on deployment 'kubo' on 'my-bosh'
Director task 886640
Task 886640 done
+--------------------------------------------------+---------+---------+---------+--------------+
| Instance | State | AZ | VM Type | IPs |
+--------------------------------------------------+---------+---------+---------+--------------+
| etcd/0 (9ce829f9-bebb-4b3d-8546-ad982f38920a)* | running | default | small | 172.16.21.7 |
| etcd | running | | | |
| etcd_consistency_checker | running | | | |
+--------------------------------------------------+---------+---------+---------+--------------+
| master/0 (e89abc82-a44f-45e3-9f86-4b50589ee288)* | running | default | small | 172.16.21.9 |
| kubernetes-api | running | | | |
| kubernetes-controller-manager | running | | | |
| kubernetes-scheduler | running | | | |
+--------------------------------------------------+---------+---------+---------+--------------+
| worker/0 (966fb1f2-fe36-4a1f-af3a-674310cf910d)* | failing | default | small | 172.16.21.14 |
| flanneld | failing | | | |
| docker | unknown | | | |
| kubelet | unknown | | | |
| kubernetes-proxy | running | | | |
+--------------------------------------------------+---------+---------+---------+--------------+
my manifest
name: kubo
director_uuid: dae9452b-0148-4cad-a860-6925024ad55a
releases:
- name: etcd
version: 108+dev.2
url: https://storage.googleapis.com/kubo-etcd/kubo-etcd-release.108%2Bdev.2.tgz
sha1: 6f452dae3d6399b38cbdee983847b81f88fc8163
- name: kubo
version: latest
- name: docker
version: 28.0.1
url: https://bosh.io/d/github.com/cf-platform-eng/docker-boshrelease?v=28.0.1
sha1: 448eaa2f478dc8794933781b478fae02aa44ed6b
stemcells:
- alias: trusty
os: ubuntu-trusty
version: latest
instance_groups:
- name: etcd
instances: 1
networks:
- name: &network-name kubo_network
azs: [default]
jobs:
- name: etcd
release: etcd
properties:
etcd:
require_ssl: false
peer_require_ssl: false
stemcell: trusty
vm_type: small
persistent_disk_type: 5g
- name: master
instances: 1
networks:
- name: *network-name
azs: [default]
jobs:
- name: kubernetes-api
release: kubo
properties:
admin-username: admin
admin-password: aaa
kubelet-password: bbb
tls:
kubernetes: xxx
- name: kubeconfig
release: kubo
properties:
kubernetes-api-url: &kubo_url "https://192.168.17.88:8443"
kubelet-password: bbb
tls:
kubernetes: xxx
- name: kubernetes-controller-manager
release: kubo
- name: kubernetes-scheduler
release: kubo
- name: kubernetes-system-specs
release: kubo
properties:
kubernetes-api-url: *kubo_url
stemcell: trusty
vm_type: small
- name: worker
instances: 1
networks:
- name: *network-name
azs: [default]
jobs:
- name: flanneld
release: kubo
- name: docker
release: docker
properties:
docker:
flannel: true
iptables: false
ip_masq: false
log_level: error
storage_driver: overlay
env: {}
- name: kubeconfig
release: kubo
properties:
kubernetes-api-url: *kubo_url
kubelet-password: bbb
tls:
kubernetes: xxx
- name: kubelet
release: kubo
properties:
kubernetes-api-url: *kubo_url
tls:
kubelet: xxx
- name: kubernetes-proxy
release: kubo
properties:
kubernetes-api-url: *kubo_url
stemcell: trusty
vm_type: small
persistent_disk_type: 10g
update:
canaries: 1
canary_watch_time: 10000-600000
max_in_flight: 1
serial: true
update_watch_time: 10000-600000
variables:
- name: kubo-admin-password
type: aaa
- name: kubelet-password
type: bbb