Comments (6)
weekface
commented on August 28, 2024
pd start args:
/pd-server --data-dir=/var/lib/pd/data --name=demo-cluster-pd-3 --peer-urls=http://0.0.0.0:2380 --advertise-peer-urls=http://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 --client-urls=http://0.0.0.0:2379 --advertise-client-urls=http://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2379 --config=/etc/pd/pd.toml --join=http://demo-cluster-pd-0.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380,http://demo-cluster-pd-1.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380,http://demo-cluster-pd-2.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380
The new error messages:
2018/10/18 03:42:30.070 util.go:62: [info] Welcome to Placement Driver (PD).
2018/10/18 03:42:30.071 util.go:63: [info] Release Version: v2.0.5
2018/10/18 03:42:30.071 util.go:64: [info] Git Commit Hash: b64716707b7279a4ae822be767085ff17b5f3fea
2018/10/18 03:42:30.071 util.go:65: [info] Git Branch: release-2.0
2018/10/18 03:42:30.071 util.go:66: [info] UTC Build Time: 2018-07-06 10:27:51
2018/10/18 03:42:30.071 metricutil.go:83: [info] disable Prometheus push client
2018/10/18 03:42:30.090 server.go:96: [info] PD config - Config({FlagSet:0xc4201f0660 Version:false ClientUrls:http://0.0.0.0:2379 PeerUrls:http://0.0.0.0:2380 AdvertiseClientUrls:h
ttp://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2379 AdvertisePeerUrls:http://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 Name:demo-cluster-pd
-3 DataDir:/var/lib/pd/data InitialCluster:demo-cluster-pd-0=http://demo-cluster-pd-0.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380,demo-cluster-pd-2=http://demo-cluster-pd-2.demo-
cluster-pd-peer.tidb-cluster-e2e.svc:2380,demo-cluster-pd-1=http://demo-cluster-pd-1.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380,demo-cluster-pd-3=http://demo-cluster-pd-3.demo-c
luster-pd-peer.tidb-cluster-e2e.svc:2380 InitialClusterState:existing Join:http://demo-cluster-pd-0.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380,http://demo-cluster-pd-1.demo-clus
ter-pd-peer.tidb-cluster-e2e.svc:2380,http://demo-cluster-pd-2.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 LeaderLease:3 Log:{Level:info Format:text DisableTimestamp:false File:{
Filename:/var/lib/pd/pd.log LogRotate:true MaxSize:3000 MaxDays:28 MaxBackups:7}} LogFileDeprecated: LogLevelDeprecated: TsoSaveInterval:3s Metric:{PushJob:demo-cluster-pd-3 PushAdd
ress: PushInterval:15s} Schedule:{MaxSnapshotCount:3 MaxPendingPeerCount:16 MaxMergeRegionSize:0 SplitMergeInterval:1h0m0s PatrolRegionInterval:100ms MaxStoreDownTime:1h0m0s LeaderS
cheduleLimit:4 RegionScheduleLimit:4 ReplicaScheduleLimit:8 MergeScheduleLimit:8 TolerantSizeRatio:5 LowSpaceRatio:0.8 HighSpaceRatio:0.6 EnableRaftLearner:false Schedulers:[{Type:b
alance-region Args:[] Disable:false} {Type:balance-leader Args:[] Disable:false} {Type:hot-region Args:[] Disable:false} {Type:label Args:[] Disable:false}]} Replication:{MaxReplica
s:3 LocationLabels:[zone rack host]} Namespace:map[] QuotaBackendBytes:0 AutoCompactionRetention:1 TickInterval:500ms ElectionInterval:3s Security:{CAPath: CertPath: KeyPath:} Label
Property:map[] configFile:/etc/pd/pd.toml WarningMsgs:[] NamespaceClassifier:default nextRetryDelay:1000000000 disableStrictReconfigCheck:false heartbeatStreamBindInterval:{Duration
:60000000000} leaderPriorityCheckInterval:{Duration:60000000000}})
2018/10/18 03:42:30.093 server.go:122: [info] start embed etcd
2018/10/18 03:42:30.093 log.go:86: [info] embed: [listening for peers on http://0.0.0.0:2380]
2018/10/18 03:42:30.093 log.go:86: [info] embed: [pprof is enabled under /debug/pprof]
2018/10/18 03:42:30.093 log.go:86: [info] embed: [listening for client requests on 0.0.0.0:2379]
2018/10/18 03:42:30.093 systime_mon.go:24: [info] start system time monitor
2018/10/18 03:42:30.156 main.go:92: [fatal] run server failed: error validating peerURLs {ClusterID:e113a4608f4a1b94 Members:[&{ID:12c400c11fde50a1 RaftAttributes:{PeerURLs:[http://
demo-cluster-pd-0.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380]} Attributes:{Name:demo-cluster-pd-0 ClientURLs:[http://demo-cluster-pd-0.demo-cluster-pd-peer.tidb-cluster-e2e.svc:
2379]}} &{ID:1b330006834e69dd RaftAttributes:{PeerURLs:[http://demo-cluster-pd-2.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380]} Attributes:{Name:demo-cluster-pd-2 ClientURLs:[http
://demo-cluster-pd-2.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2379]}} &{ID:1cefec7acc79d7dd RaftAttributes:{PeerURLs:[http://demo-cluster-pd-1.demo-cluster-pd-peer.tidb-cluster-e2e
.svc:2380]} Attributes:{Name:demo-cluster-pd-1 ClientURLs:[http://demo-cluster-pd-1.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2379]}}] RemovedMemberIDs:[]}: member count is unequal
/home/jenkins/workspace/build_pd_2.0/go/src/github.com/pingcap/pd/server/server.go:125:
/home/jenkins/workspace/build_pd_2.0/go/src/github.com/pingcap/pd/server/server.go:276:
2018/10/18 03:42:32.585 util.go:62: [info] Welcome to Placement Driver (PD).
2018/10/18 03:42:32.585 util.go:63: [info] Release Version: v2.0.5
2018/10/18 03:42:32.585 util.go:64: [info] Git Commit Hash: b64716707b7279a4ae822be767085ff17b5f3fea
2018/10/18 03:42:32.585 util.go:65: [info] Git Branch: release-2.0
2018/10/18 03:42:32.585 util.go:66: [info] UTC Build Time: 2018-07-06 10:27:51
2018/10/18 03:42:32.585 metricutil.go:83: [info] disable Prometheus push client
2018/10/18 03:42:32.586 server.go:96: [info] PD config - Config({FlagSet:0xc4201f0660 Version:false ClientUrls:http://0.0.0.0:2379 PeerUrls:http://0.0.0.0:2380 AdvertiseClientUrls:h
ttp://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2379 AdvertisePeerUrls:http://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 Name:demo-cluster-pd
-3 DataDir:/var/lib/pd/data InitialCluster: InitialClusterState:existing Join:http://demo-cluster-pd-0.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380,http://demo-cluster-pd-1.demo-c
luster-pd-peer.tidb-cluster-e2e.svc:2380,http://demo-cluster-pd-2.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 LeaderLease:3 Log:{Level:info Format:text DisableTimestamp:false Fil
e:{Filename:/var/lib/pd/pd.log LogRotate:true MaxSize:3000 MaxDays:28 MaxBackups:7}} LogFileDeprecated: LogLevelDeprecated: TsoSaveInterval:3s Metric:{PushJob:demo-cluster-pd-3 Push
Address: PushInterval:15s} Schedule:{MaxSnapshotCount:3 MaxPendingPeerCount:16 MaxMergeRegionSize:0 SplitMergeInterval:1h0m0s PatrolRegionInterval:100ms MaxStoreDownTime:1h0m0s Lead
erScheduleLimit:4 RegionScheduleLimit:4 ReplicaScheduleLimit:8 MergeScheduleLimit:8 TolerantSizeRatio:5 LowSpaceRatio:0.8 HighSpaceRatio:0.6 EnableRaftLearner:false Schedulers:[{Typ
e:balance-region Args:[] Disable:false} {Type:balance-leader Args:[] Disable:false} {Type:hot-region Args:[] Disable:false} {Type:label Args:[] Disable:false}]} Replication:{MaxRepl
icas:3 LocationLabels:[zone rack host]} Namespace:map[] QuotaBackendBytes:0 AutoCompactionRetention:1 TickInterval:500ms ElectionInterval:3s Security:{CAPath: CertPath: KeyPath:} La
belProperty:map[] configFile:/etc/pd/pd.toml WarningMsgs:[] NamespaceClassifier:default nextRetryDelay:1000000000 disableStrictReconfigCheck:false heartbeatStreamBindInterval:{Durat
ion:60000000000} leaderPriorityCheckInterval:{Duration:60000000000}})
2018/10/18 03:42:32.587 server.go:122: [info] start embed etcd
2018/10/18 03:42:32.588 log.go:86: [info] embed: [listening for peers on http://0.0.0.0:2380]
2018/10/18 03:42:32.588 log.go:86: [info] embed: [pprof is enabled under /debug/pprof]
2018/10/18 03:42:32.588 log.go:86: [info] embed: [listening for client requests on 0.0.0.0:2379]
2018/10/18 03:42:32.588 systime_mon.go:24: [info] start system time monitor
2018/10/18 03:42:32.601 main.go:92: [fatal] run server failed: couldn't find local name "demo-cluster-pd-3" in the initial cluster configuration
/home/jenkins/workspace/build_pd_2.0/go/src/github.com/pingcap/pd/server/server.go:125:
/home/jenkins/workspace/build_pd_2.0/go/src/github.com/pingcap/pd/server/server.go:276:
2018/10/18 03:42:49.222 util.go:62: [info] Welcome to Placement Driver (PD).
2018/10/18 03:42:49.222 util.go:63: [info] Release Version: v2.0.5
2018/10/18 03:42:49.222 util.go:64: [info] Git Commit Hash: b64716707b7279a4ae822be767085ff17b5f3fea
2018/10/18 03:42:49.222 util.go:65: [info] Git Branch: release-2.0
2018/10/18 03:42:49.222 util.go:66: [info] UTC Build Time: 2018-07-06 10:27:51
2018/10/18 03:42:49.222 metricutil.go:83: [info] disable Prometheus push client
2018/10/18 03:42:49.223 server.go:96: [info] PD config - Config({FlagSet:0xc4201f0660 Version:false ClientUrls:http://0.0.0.0:2379 PeerUrls:http://0.0.0.0:2380 AdvertiseClientUrls:h
ttp://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2379 AdvertisePeerUrls:http://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 Name:demo-cluster-pd
-3 DataDir:/var/lib/pd/data InitialCluster: InitialClusterState:existing Join:http://demo-cluster-pd-0.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380,http://demo-cluster-pd-1.demo-c
luster-pd-peer.tidb-cluster-e2e.svc:2380,http://demo-cluster-pd-2.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 LeaderLease:3 Log:{Level:info Format:text DisableTimestamp:false Fil
e:{Filename:/var/lib/pd/pd.log LogRotate:true MaxSize:3000 MaxDays:28 MaxBackups:7}} LogFileDeprecated: LogLevelDeprecated: TsoSaveInterval:3s Metric:{PushJob:demo-cluster-pd-3 Push
Address: PushInterval:15s} Schedule:{MaxSnapshotCount:3 MaxPendingPeerCount:16 MaxMergeRegionSize:0 SplitMergeInterval:1h0m0s PatrolRegionInterval:100ms MaxStoreDownTime:1h0m0s Lead
erScheduleLimit:4 RegionScheduleLimit:4 ReplicaScheduleLimit:8 MergeScheduleLimit:8 TolerantSizeRatio:5 LowSpaceRatio:0.8 HighSpaceRatio:0.6 EnableRaftLearner:false Schedulers:[{Typ
e:balance-region Args:[] Disable:false} {Type:balance-leader Args:[] Disable:false} {Type:hot-region Args:[] Disable:false} {Type:label Args:[] Disable:false}]} Replication:{MaxRepl
icas:3 LocationLabels:[zone rack host]} Namespace:map[] QuotaBackendBytes:0 AutoCompactionRetention:1 TickInterval:500ms ElectionInterval:3s Security:{CAPath: CertPath: KeyPath:} La
belProperty:map[] configFile:/etc/pd/pd.toml WarningMsgs:[] NamespaceClassifier:default nextRetryDelay:1000000000 disableStrictReconfigCheck:false heartbeatStreamBindInterval:{Durat
ion:60000000000} leaderPriorityCheckInterval:{Duration:60000000000}})
2018/10/18 03:42:49.225 server.go:122: [info] start embed etcd
2018/10/18 03:42:49.225 log.go:86: [info] embed: [listening for peers on http://0.0.0.0:2380]
2018/10/18 03:42:49.225 log.go:86: [info] embed: [pprof is enabled under /debug/pprof]
2018/10/18 03:42:49.225 log.go:86: [info] embed: [listening for client requests on 0.0.0.0:2379]
2018/10/18 03:42:49.225 systime_mon.go:24: [info] start system time monitor
2018/10/18 03:42:49.228 main.go:92: [fatal] run server failed: couldn't find local name "demo-cluster-pd-3" in the initial cluster configuration
/home/jenkins/workspace/build_pd_2.0/go/src/github.com/pingcap/pd/server/server.go:125:
/home/jenkins/workspace/build_pd_2.0/go/src/github.com/pingcap/pd/server/server.go:276:
2018/10/18 03:43:15.231 util.go:62: [info] Welcome to Placement Driver (PD).
2018/10/18 03:43:15.232 util.go:63: [info] Release Version: v2.0.5
2018/10/18 03:43:15.232 util.go:64: [info] Git Commit Hash: b64716707b7279a4ae822be767085ff17b5f3fea
2018/10/18 03:43:15.232 util.go:65: [info] Git Branch: release-2.0
2018/10/18 03:43:15.232 util.go:66: [info] UTC Build Time: 2018-07-06 10:27:51
2018/10/18 03:43:15.232 metricutil.go:83: [info] disable Prometheus push client
2018/10/18 03:43:15.232 server.go:96: [info] PD config - Config({FlagSet:0xc4201f0660 Version:false ClientUrls:http://0.0.0.0:2379 PeerUrls:http://0.0.0.0:2380 AdvertiseClientUrls:h
ttp://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2379 AdvertisePeerUrls:http://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 Name:demo-cluster-pd
-3 DataDir:/var/lib/pd/data InitialCluster: InitialClusterState:existing Join:http://demo-cluster-pd-0.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380,http://demo-cluster-pd-1.demo-c
luster-pd-peer.tidb-cluster-e2e.svc:2380,http://demo-cluster-pd-2.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 LeaderLease:3 Log:{Level:info Format:text DisableTimestamp:false Fil
e:{Filename:/var/lib/pd/pd.log LogRotate:true MaxSize:3000 MaxDays:28 MaxBackups:7}} LogFileDeprecated: LogLevelDeprecated: TsoSaveInterval:3s Metric:{PushJob:demo-cluster-pd-3 Push
Address: PushInterval:15s} Schedule:{MaxSnapshotCount:3 MaxPendingPeerCount:16 MaxMergeRegionSize:0 SplitMergeInterval:1h0m0s PatrolRegionInterval:100ms MaxStoreDownTime:1h0m0s Lead
erScheduleLimit:4 RegionScheduleLimit:4 ReplicaScheduleLimit:8 MergeScheduleLimit:8 TolerantSizeRatio:5 LowSpaceRatio:0.8 HighSpaceRatio:0.6 EnableRaftLearner:false Schedulers:[{Typ
e:balance-region Args:[] Disable:false} {Type:balance-leader Args:[] Disable:false} {Type:hot-region Args:[] Disable:false} {Type:label Args:[] Disable:false}]} Replication:{MaxRepl
icas:3 LocationLabels:[zone rack host]} Namespace:map[] QuotaBackendBytes:0 AutoCompactionRetention:1 TickInterval:500ms ElectionInterval:3s Security:{CAPath: CertPath: KeyPath:} La
belProperty:map[] configFile:/etc/pd/pd.toml WarningMsgs:[] NamespaceClassifier:default nextRetryDelay:1000000000 disableStrictReconfigCheck:false heartbeatStreamBindInterval:{Durat
ion:60000000000} leaderPriorityCheckInterval:{Duration:60000000000}})
2018/10/18 03:43:15.234 server.go:122: [info] start embed etcd
2018/10/18 03:43:15.234 log.go:86: [info] embed: [listening for peers on http://0.0.0.0:2380]
2018/10/18 03:43:15.234 log.go:86: [info] embed: [pprof is enabled under /debug/pprof]
2018/10/18 03:43:15.234 log.go:86: [info] embed: [listening for client requests on 0.0.0.0:2379]
2018/10/18 03:43:15.234 systime_mon.go:24: [info] start system time monitor
2018/10/18 03:43:15.239 main.go:92: [fatal] run server failed: couldn't find local name "demo-cluster-pd-3" in the initial cluster configuration
/home/jenkins/workspace/build_pd_2.0/go/src/github.com/pingcap/pd/server/server.go:125:
/home/jenkins/workspace/build_pd_2.0/go/src/github.com/pingcap/pd/server/server.go:276:
2018/10/18 03:44:11.269 util.go:62: [info] Welcome to Placement Driver (PD).
2018/10/18 03:44:11.269 util.go:63: [info] Release Version: v2.0.5
2018/10/18 03:44:11.269 util.go:64: [info] Git Commit Hash: b64716707b7279a4ae822be767085ff17b5f3fea
2018/10/18 03:44:11.269 util.go:65: [info] Git Branch: release-2.0
2018/10/18 03:44:11.269 util.go:66: [info] UTC Build Time: 2018-07-06 10:27:51
2018/10/18 03:44:11.269 metricutil.go:83: [info] disable Prometheus push client
2018/10/18 03:44:11.269 server.go:96: [info] PD config - Config({FlagSet:0xc4201f0660 Version:false ClientUrls:http://0.0.0.0:2379 PeerUrls:http://0.0.0.0:2380 AdvertiseClientUrls:h
ttp://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2379 AdvertisePeerUrls:http://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 Name:demo-cluster-pd
-3 DataDir:/var/lib/pd/data InitialCluster: InitialClusterState:existing Join:http://demo-cluster-pd-0.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380,http://demo-cluster-pd-1.demo-c
luster-pd-peer.tidb-cluster-e2e.svc:2380,http://demo-cluster-pd-2.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 LeaderLease:3 Log:{Level:info Format:text DisableTimestamp:false Fil
e:{Filename:/var/lib/pd/pd.log LogRotate:true MaxSize:3000 MaxDays:28 MaxBackups:7}} LogFileDeprecated: LogLevelDeprecated: TsoSaveInterval:3s Metric:{PushJob:demo-cluster-pd-3 Push
Address: PushInterval:15s} Schedule:{MaxSnapshotCount:3 MaxPendingPeerCount:16 MaxMergeRegionSize:0 SplitMergeInterval:1h0m0s PatrolRegionInterval:100ms MaxStoreDownTime:1h0m0s Lead
erScheduleLimit:4 RegionScheduleLimit:4 ReplicaScheduleLimit:8 MergeScheduleLimit:8 TolerantSizeRatio:5 LowSpaceRatio:0.8 HighSpaceRatio:0.6 EnableRaftLearner:false Schedulers:[{Typ
e:balance-region Args:[] Disable:false} {Type:balance-leader Args:[] Disable:false} {Type:hot-region Args:[] Disable:false} {Type:label Args:[] Disable:false}]} Replication:{MaxRepl
icas:3 LocationLabels:[zone rack host]} Namespace:map[] QuotaBackendBytes:0 AutoCompactionRetention:1 TickInterval:500ms ElectionInterval:3s Security:{CAPath: CertPath: KeyPath:} La
belProperty:map[] configFile:/etc/pd/pd.toml WarningMsgs:[] NamespaceClassifier:default nextRetryDelay:1000000000 disableStrictReconfigCheck:false heartbeatStreamBindInterval:{Durat
ion:60000000000} leaderPriorityCheckInterval:{Duration:60000000000}})
2018/10/18 03:44:11.271 server.go:122: [info] start embed etcd
2018/10/18 03:44:11.271 log.go:86: [info] embed: [listening for peers on http://0.0.0.0:2380]
2018/10/18 03:44:11.271 log.go:86: [info] embed: [pprof is enabled under /debug/pprof]
2018/10/18 03:44:11.271 log.go:86: [info] embed: [listening for client requests on 0.0.0.0:2379]
2018/10/18 03:44:11.272 systime_mon.go:24: [info] start system time monitor
2018/10/18 03:44:11.275 main.go:92: [fatal] run server failed: couldn't find local name "demo-cluster-pd-3" in the initial cluster configuration
/home/jenkins/workspace/build_pd_2.0/go/src/github.com/pingcap/pd/server/server.go:125:
/home/jenkins/workspace/build_pd_2.0/go/src/github.com/pingcap/pd/server/server.go:276:
from tidb-operator.
nolouch
commented on August 28, 2024
i deleted this no-name member, it works:
$ curl -XDELETE 10.103.241.52:2379/pd/api/v1/members/id/1429482795436666386
can you show me the log after you delete it.
from tidb-operator.
weekface
commented on August 28, 2024
When i deleted this no-name member, other pd's logs:
2018/10/18 08:41:11.246 log.go:86: [info] etcdserver/membership: [removed member 312420d38578a47f from cluster e113a4608f4a1b94]
2018/10/18 08:41:11.246 log.go:86: [info] rafthttp: [stopping peer 312420d38578a47f...]
2018/10/18 08:41:11.246 log.go:86: [info] rafthttp: [stopped streaming with peer 312420d38578a47f (writer)]
2018/10/18 08:41:11.246 log.go:86: [info] rafthttp: [stopped streaming with peer 312420d38578a47f (writer)]
2018/10/18 08:41:11.246 log.go:86: [info] rafthttp: [stopped HTTP pipelining with peer 312420d38578a47f]
2018/10/18 08:41:11.247 log.go:86: [info] rafthttp: [stopped streaming with peer 312420d38578a47f (stream MsgApp v2 reader)]
2018/10/18 08:41:11.247 log.go:86: [info] rafthttp: [stopped streaming with peer 312420d38578a47f (stream Message reader)]
2018/10/18 08:41:11.247 log.go:86: [info] rafthttp: [stopped peer 312420d38578a47f]
2018/10/18 08:41:11.247 log.go:86: [info] rafthttp: [removed peer 312420d38578a47f]
from tidb-operator.
weekface
commented on August 28, 2024
2018/10/22 13:21:49.368 util.go:62: [info] Welcome to Placement Driver (PD).
2018/10/22 13:21:49.369 util.go:63: [info] Release Version: v2.0.5-dirty
2018/10/22 13:21:49.369 util.go:64: [info] Git Commit Hash: b64716707b7279a4ae822be767085ff17b5f3fea
2018/10/22 13:21:49.369 util.go:65: [info] Git Branch: HEAD
2018/10/22 13:21:49.369 util.go:66: [info] UTC Build Time: 2018-10-19 07:31:50
2018/10/22 13:21:49.369 metricutil.go:83: [info] disable Prometheus push client
2018/10/22 13:16:02.292 util.go:62: [info] Welcome to Placement Driver (PD).
2018/10/22 13:16:02.293 util.go:63: [info] Release Version: v2.0.5-dirty
2018/10/22 13:16:02.293 util.go:64: [info] Git Commit Hash: b64716707b7279a4ae822be767085ff17b5f3fea
2018/10/22 13:16:02.293 util.go:65: [info] Git Branch: HEAD
2018/10/22 13:16:02.293 util.go:66: [info] UTC Build Time: 2018-10-19 07:31:50
2018/10/22 13:16:02.293 metricutil.go:83: [info] disable Prometheus push client
2018/10/22 13:16:02.347 server.go:96: [info] PD config - Config({FlagSet:0xc4201c8660 Version:false ClientUrls:http://0.0.0.0:2379 PeerUrls:http://0.0.0.0:2380 AdvertiseClientUrls:h
ttp://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2379 AdvertisePeerUrls:http://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 Name:demo-cluster-pd
-3 DataDir:/var/lib/pd/data InitialCluster:demo-cluster-pd-0=http://demo-cluster-pd-0.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380,demo-cluster-pd-1=http://demo-cluster-pd-1.demo-
cluster-pd-peer.tidb-cluster-e2e.svc:2380,demo-cluster-pd-2=http://demo-cluster-pd-2.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380,demo-cluster-pd-3=http://demo-cluster-pd-3.demo-c
luster-pd-peer.tidb-cluster-e2e.svc:2380 InitialClusterState:existing Join:http://demo-cluster-pd-0.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380,http://demo-cluster-pd-1.demo-clus
ter-pd-peer.tidb-cluster-e2e.svc:2380,http://demo-cluster-pd-2.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 LeaderLease:3 Log:{Level:info Format:text DisableTimestamp:false File:{
Filename:/var/lib/pd/pd.log LogRotate:true MaxSize:3000 MaxDays:28 MaxBackups:7}} LogFileDeprecated: LogLevelDeprecated: TsoSaveInterval:3s Metric:{PushJob:demo-cluster-pd-3 PushAdd
ress: PushInterval:15s} Schedule:{MaxSnapshotCount:3 MaxPendingPeerCount:16 MaxMergeRegionSize:0 SplitMergeInterval:1h0m0s PatrolRegionInterval:100ms MaxStoreDownTime:1h0m0s LeaderS
cheduleLimit:4 RegionScheduleLimit:4 ReplicaScheduleLimit:8 MergeScheduleLimit:8 TolerantSizeRatio:5 LowSpaceRatio:0.8 HighSpaceRatio:0.6 EnableRaftLearner:false Schedulers:[{Type:b
alance-region Args:[] Disable:false} {Type:balance-leader Args:[] Disable:false} {Type:hot-region Args:[] Disable:false} {Type:label Args:[] Disable:false}]} Replication:{MaxReplica
s:3 LocationLabels:[zone rack host]} Namespace:map[] QuotaBackendBytes:0 AutoCompactionRetention:1 TickInterval:500ms ElectionInterval:3s Security:{CAPath: CertPath: KeyPath:} Label
Property:map[] configFile:/etc/pd/pd.toml WarningMsgs:[] NamespaceClassifier:default nextRetryDelay:1000000000 disableStrictReconfigCheck:false heartbeatStreamBindInterval:{Duration
:60000000000} leaderPriorityCheckInterval:{Duration:60000000000}})
2018/10/22 13:16:02.349 server.go:122: [info] start embed etcd
2018/10/22 13:16:02.350 log.go:86: [info] embed: [listening for peers on http://0.0.0.0:2380]
2018/10/22 13:16:02.350 log.go:86: [info] embed: [pprof is enabled under /debug/pprof]
2018/10/22 13:16:02.350 log.go:86: [info] embed: [listening for client requests on 0.0.0.0:2379]
2018/10/22 13:16:02.350 systime_mon.go:24: [info] start system time monitor
2018/10/22 13:16:02.398 main.go:92: [fatal] run server failed: error validating peerURLs {ClusterID:e113a4608f4a1b94 Members:[&{ID:20b33ad53624ae8f RaftAttributes:{PeerURLs:[http://
demo-cluster-pd-1.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380]} Attributes:{Name:demo-cluster-pd-1 ClientURLs:[http://demo-cluster-pd-1.demo-cluster-pd-peer.tidb-cluster-e2e.svc:
2379]}} &{ID:a79afaba07c7dc07 RaftAttributes:{PeerURLs:[http://demo-cluster-pd-2.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380]} Attributes:{Name:demo-cluster-pd-2 ClientURLs:[http
://demo-cluster-pd-2.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2379]}} &{ID:dcd20634bc4bff12 RaftAttributes:{PeerURLs:[http://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e
.svc:2380]} Attributes:{Name: ClientURLs:[]}} &{ID:12c400c11fde50a1 RaftAttributes:{PeerURLs:[http://demo-cluster-pd-0.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380]} Attributes:{N
ame:demo-cluster-pd-0 ClientURLs:[http://demo-cluster-pd-0.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2379]}} &{ID:185f4d044cc002c2 RaftAttributes:{PeerURLs:[http://demo-cluster-pd-4
.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380]} Attributes:{Name: ClientURLs:[]}}] RemovedMemberIDs:[]}: member count is unequal
/local/go/src/github.com/pingcap/pd/server/server.go:125:
/local/go/src/github.com/pingcap/pd/server/server.go:276:
$ cat join
demo-cluster-pd-0=http://demo-cluster-pd-0.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380,demo-cluster-pd-1=http://demo-cluster-pd-1.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380,demo-cluster-pd-2=http://demo-cluster-pd-2.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380,demo-cluster-pd-3=http://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380
from tidb-operator.
weekface
commented on August 28, 2024
demo-cluster-pd-4:
2018/10/22 13:16:02.306 util.go:62: [info] Welcome to Placement Driver (PD).
2018/10/22 13:16:02.307 util.go:63: [info] Release Version: v2.0.5-dirty
2018/10/22 13:16:02.307 util.go:64: [info] Git Commit Hash: b64716707b7279a4ae822be767085ff17b5f3fea
2018/10/22 13:16:02.307 util.go:65: [info] Git Branch: HEAD
2018/10/22 13:16:02.307 util.go:66: [info] UTC Build Time: 2018-10-19 07:31:50
2018/10/22 13:16:02.307 metricutil.go:83: [info] disable Prometheus push client
2018/10/22 13:16:02.392 server.go:96: [info] PD config - Config({FlagSet:0xc4201c8660 Version:false ClientUrls:http://0.0.0.0:2379 PeerUrls:http://0.0.0.0:2380 AdvertiseClientUrls:h
ttp://demo-cluster-pd-4.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2379 AdvertisePeerUrls:http://demo-cluster-pd-4.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 Name:demo-cluster-pd
-4 DataDir:/var/lib/pd/data InitialCluster:demo-cluster-pd-0=http://demo-cluster-pd-0.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380,demo-cluster-pd-4=http://demo-cluster-pd-4.demo-
cluster-pd-peer.tidb-cluster-e2e.svc:2380,demo-cluster-pd-1=http://demo-cluster-pd-1.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380,demo-cluster-pd-2=http://demo-cluster-pd-2.demo-c
luster-pd-peer.tidb-cluster-e2e.svc:2380,=http://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 InitialClusterState:existing Join:http://demo-cluster-pd-0.demo-clu
ster-pd-peer.tidb-cluster-e2e.svc:2380,http://demo-cluster-pd-1.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380,http://demo-cluster-pd-2.demo-cluster-pd-peer.tidb-cluster-e2e.svc:238
0,http://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 LeaderLease:3 Log:{Level:info Format:text DisableTimestamp:false File:{Filename:/var/lib/pd/pd.log LogRotat
e:true MaxSize:3000 MaxDays:28 MaxBackups:7}} LogFileDeprecated: LogLevelDeprecated: TsoSaveInterval:3s Metric:{PushJob:demo-cluster-pd-4 PushAddress: PushInterval:15s} Schedule:{Ma
xSnapshotCount:3 MaxPendingPeerCount:16 MaxMergeRegionSize:0 SplitMergeInterval:1h0m0s PatrolRegionInterval:100ms MaxStoreDownTime:1h0m0s LeaderScheduleLimit:4 RegionScheduleLimit:4
ReplicaScheduleLimit:8 MergeScheduleLimit:8 TolerantSizeRatio:5 LowSpaceRatio:0.8 HighSpaceRatio:0.6 EnableRaftLearner:false Schedulers:[{Type:balance-region Args:[] Disable:false}
{Type:balance-leader Args:[] Disable:false} {Type:hot-region Args:[] Disable:false} {Type:label Args:[] Disable:false}]} Replication:{MaxReplicas:3 LocationLabels:[zone rack host]}
Namespace:map[] QuotaBackendBytes:0 AutoCompactionRetention:1 TickInterval:500ms ElectionInterval:3s Security:{CAPath: CertPath: KeyPath:} LabelProperty:map[] configFile:/etc/pd/pd
.toml WarningMsgs:[] NamespaceClassifier:default nextRetryDelay:1000000000 disableStrictReconfigCheck:false heartbeatStreamBindInterval:{Duration:60000000000} leaderPriorityCheckInt
erval:{Duration:60000000000}})
2018/10/22 13:16:02.395 server.go:122: [info] start embed etcd
2018/10/22 13:16:02.395 log.go:86: [info] embed: [listening for peers on http://0.0.0.0:2380]
2018/10/22 13:16:02.395 log.go:86: [info] embed: [pprof is enabled under /debug/pprof]
2018/10/22 13:16:02.395 log.go:86: [info] embed: [listening for client requests on 0.0.0.0:2379]
2018/10/22 13:16:02.396 systime_mon.go:24: [info] start system time monitor
2018/10/22 13:16:02.409 log.go:86: [info] pkg/netutil: [resolving demo-cluster-pd-0.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 to 10.60.0.189:2380]
2018/10/22 13:16:02.412 log.go:86: [info] pkg/netutil: [resolving demo-cluster-pd-0.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 to 10.60.0.189:2380]
2018/10/22 13:16:02.420 log.go:86: [info] pkg/netutil: [resolving demo-cluster-pd-1.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 to 10.60.1.147:2380]
2018/10/22 13:16:02.422 log.go:86: [info] pkg/netutil: [resolving demo-cluster-pd-1.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 to 10.60.1.147:2380]
2018/10/22 13:16:02.424 log.go:86: [info] pkg/netutil: [resolving demo-cluster-pd-2.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 to 10.60.3.45:2380]
2018/10/22 13:16:02.428 log.go:86: [info] pkg/netutil: [resolving demo-cluster-pd-2.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 to 10.60.3.45:2380]
2018/10/22 13:16:02.431 log.go:86: [info] pkg/netutil: [resolving demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 to 10.60.2.215:2380]
2018/10/22 13:16:02.440 log.go:86: [info] pkg/netutil: [resolving demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 to 10.60.2.215:2380]
2018/10/22 13:16:02.442 log.go:86: [info] pkg/netutil: [resolving demo-cluster-pd-4.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 to 10.60.1.149:2380]
2018/10/22 13:16:02.444 log.go:86: [info] pkg/netutil: [resolving demo-cluster-pd-4.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 to 10.60.1.149:2380]
2018/10/22 13:16:02.453 log.go:82: [warning] etcdserver: [failed to reach the peerURL(http://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380) of member dcd20634bc4b
ff12 (Get http://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380/version: dial tcp 10.60.2.215:2380: getsockopt: connection refused)]
2018/10/22 13:16:02.453 log.go:82: [warning] etcdserver: [cannot get the version of member dcd20634bc4bff12 (Get http://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2
380/version: dial tcp 10.60.2.215:2380: getsockopt: connection refused)]
2018/10/22 13:16:02.453 log.go:86: [info] etcdserver: [name = demo-cluster-pd-4]
2018/10/22 13:16:02.453 log.go:86: [info] etcdserver: [data dir = /var/lib/pd/data]
2018/10/22 13:16:02.453 log.go:86: [info] etcdserver: [member dir = /var/lib/pd/data/member]
2018/10/22 13:16:02.453 log.go:86: [info] etcdserver: [heartbeat = 500ms]
2018/10/22 13:16:02.453 log.go:86: [info] etcdserver: [election = 3000ms]
demo-cluster-pd-3:
2018/10/22 13:16:02.292 util.go:62: [info] Welcome to Placement Driver (PD).
2018/10/22 13:16:02.293 util.go:63: [info] Release Version: v2.0.5-dirty
2018/10/22 13:16:02.293 util.go:64: [info] Git Commit Hash: b64716707b7279a4ae822be767085ff17b5f3fea
2018/10/22 13:16:02.293 util.go:65: [info] Git Branch: HEAD
2018/10/22 13:16:02.293 util.go:66: [info] UTC Build Time: 2018-10-19 07:31:50
2018/10/22 13:16:02.293 metricutil.go:83: [info] disable Prometheus push client
2018/10/22 13:16:02.347 server.go:96: [info] PD config - Config({FlagSet:0xc4201c8660 Version:false ClientUrls:http://0.0.0.0:2379 PeerUrls:http://0.0.0.0:2380 AdvertiseClientUrls:h
ttp://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2379 AdvertisePeerUrls:http://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 Name:demo-cluster-pd
-3 DataDir:/var/lib/pd/data InitialCluster:demo-cluster-pd-0=http://demo-cluster-pd-0.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380,demo-cluster-pd-1=http://demo-cluster-pd-1.demo-
cluster-pd-peer.tidb-cluster-e2e.svc:2380,demo-cluster-pd-2=http://demo-cluster-pd-2.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380,demo-cluster-pd-3=http://demo-cluster-pd-3.demo-c
luster-pd-peer.tidb-cluster-e2e.svc:2380 InitialClusterState:existing Join:http://demo-cluster-pd-0.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380,http://demo-cluster-pd-1.demo-clus
ter-pd-peer.tidb-cluster-e2e.svc:2380,http://demo-cluster-pd-2.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380 LeaderLease:3 Log:{Level:info Format:text DisableTimestamp:false File:{
Filename:/var/lib/pd/pd.log LogRotate:true MaxSize:3000 MaxDays:28 MaxBackups:7}} LogFileDeprecated: LogLevelDeprecated: TsoSaveInterval:3s Metric:{PushJob:demo-cluster-pd-3 PushAdd
ress: PushInterval:15s} Schedule:{MaxSnapshotCount:3 MaxPendingPeerCount:16 MaxMergeRegionSize:0 SplitMergeInterval:1h0m0s PatrolRegionInterval:100ms MaxStoreDownTime:1h0m0s LeaderS
cheduleLimit:4 RegionScheduleLimit:4 ReplicaScheduleLimit:8 MergeScheduleLimit:8 TolerantSizeRatio:5 LowSpaceRatio:0.8 HighSpaceRatio:0.6 EnableRaftLearner:false Schedulers:[{Type:b
alance-region Args:[] Disable:false} {Type:balance-leader Args:[] Disable:false} {Type:hot-region Args:[] Disable:false} {Type:label Args:[] Disable:false}]} Replication:{MaxReplica
s:3 LocationLabels:[zone rack host]} Namespace:map[] QuotaBackendBytes:0 AutoCompactionRetention:1 TickInterval:500ms ElectionInterval:3s Security:{CAPath: CertPath: KeyPath:} Label
Property:map[] configFile:/etc/pd/pd.toml WarningMsgs:[] NamespaceClassifier:default nextRetryDelay:1000000000 disableStrictReconfigCheck:false heartbeatStreamBindInterval:{Duration
:60000000000} leaderPriorityCheckInterval:{Duration:60000000000}})
2018/10/22 13:16:02.349 server.go:122: [info] start embed etcd
2018/10/22 13:16:02.350 log.go:86: [info] embed: [listening for peers on http://0.0.0.0:2380]
2018/10/22 13:16:02.350 log.go:86: [info] embed: [pprof is enabled under /debug/pprof]
2018/10/22 13:16:02.350 log.go:86: [info] embed: [listening for client requests on 0.0.0.0:2379]
2018/10/22 13:16:02.350 systime_mon.go:24: [info] start system time monitor
2018/10/22 13:16:02.398 main.go:92: [fatal] run server failed: error validating peerURLs {ClusterID:e113a4608f4a1b94 Members:[&{ID:20b33ad53624ae8f RaftAttributes:{PeerURLs:[http://
demo-cluster-pd-1.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380]} Attributes:{Name:demo-cluster-pd-1 ClientURLs:[http://demo-cluster-pd-1.demo-cluster-pd-peer.tidb-cluster-e2e.svc:
2379]}} &{ID:a79afaba07c7dc07 RaftAttributes:{PeerURLs:[http://demo-cluster-pd-2.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380]} Attributes:{Name:demo-cluster-pd-2 ClientURLs:[http
://demo-cluster-pd-2.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2379]}} &{ID:dcd20634bc4bff12 RaftAttributes:{PeerURLs:[http://demo-cluster-pd-3.demo-cluster-pd-peer.tidb-cluster-e2e
.svc:2380]} Attributes:{Name: ClientURLs:[]}} &{ID:12c400c11fde50a1 RaftAttributes:{PeerURLs:[http://demo-cluster-pd-0.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380]} Attributes:{N
ame:demo-cluster-pd-0 ClientURLs:[http://demo-cluster-pd-0.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2379]}} &{ID:185f4d044cc002c2 RaftAttributes:{PeerURLs:[http://demo-cluster-pd-4
.demo-cluster-pd-peer.tidb-cluster-e2e.svc:2380]} Attributes:{Name: ClientURLs:[]}}] RemovedMemberIDs:[]}: member count is unequal
/local/go/src/github.com/pingcap/pd/server/server.go:125:
/local/go/src/github.com/pingcap/pd/server/server.go:276:
pd-4 started before pd-3
from tidb-operator.
weekface
commented on August 28, 2024
#142 and tikv/pd#1279 fixes this issue.
from tidb-operator.
Related Issues (20)
- Operator not update runing pods affinity by scaling tikv HOT 2
- Allow tidb initializer to run on hostnetwork HOT 2
- Improve observability of tidb operator HOT 1
- pprof endpoints are not working HOT 1
- br: volume-snapshot can not restore when backup a scale-in cluster
- hand on scale in if pod start after store already tombstone
- PD physical delete API support
- Release v1.4.3
- Move crds define to operator HOT 1
- Release v1.3.10
- Not Support Graceful Drain for Customized Image Tag
- br: add a new check for tikv encryption during the volume-snapshot restore
- Rely on external-resizer to adjust TiKV storage size HOT 1
- TidbInitializer failed when enable-sem is true HOT 1
- Sync failed when using custom build of tidb with image version that's not in semantic version format
- br: volume snapshot backup panic when calc backup size
- br: volume-snapshot backup size calc test coverage improvement
- storage.engine gets removed by operator after having been set HOT 1
- Release v1.4.4
- PD url in discovery service need to be fix HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tidb-operator.