Comments (5)
Thanks for your patience, could you help to paste more outputs here? Such as logs, iptables-save...
from hybridnet.
Here is my pods status. 10.14.100.0/24 is my overlay subnet, while 192.168.56.0/24 is the underlay of mine.
[admin@master-node ~]$ kubectl get pods -owide
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
curl-overlay-cc54b95cc-5j6ch 1/1 Running 0 24h 10.14.100.10 node-1 <none> <none>
curl-overlay-cc54b95cc-kwngr 1/1 Running 0 24h 10.14.100.11 node-1 <none> <none>
curl-overlay-cc54b95cc-w4kvl 1/1 Running 0 24h 10.14.100.12 node-1 <none> <none>
curl-underlay-6bfc4f74dd-d4q7h 1/1 Running 0 24h 192.168.56.13 node-1 <none> <none>
curl-underlay-6bfc4f74dd-n8b54 1/1 Running 0 24h 192.168.56.12 node-1 <none> <none>
curl-underlay-6bfc4f74dd-xng6q 1/1 Running 0 24h 192.168.56.11 node-1 <none> <none>
hello-overlay-7c8464b6cc-4557t 1/1 Running 0 24h 10.14.100.14 node-1 <none> <none>
hello-overlay-7c8464b6cc-rjtdb 1/1 Running 0 24h 10.14.100.13 node-1 <none> <none>
hello-overlay-7c8464b6cc-wjdnk 1/1 Running 0 24h 10.14.100.15 node-1 <none> <none>
Here is rama related entries ofiptables-save
on node-1:
[admin@node-1 ~]$ sudo iptables-save | grep -i RAMA
-A KUBE-SERVICES -d 10.108.2.43/32 -p tcp -m comment --comment "kube-system/rama-webhook:webhook-port cluster IP" -m tcp --dport 443 -j KUBE-SVC-JPPFOI7P5T62DDAU
# Warning: iptables-legacy tables present, use iptables-legacy-save to see them
-A KUBE-SVC-JPPFOI7P5T62DDAU -m comment --comment "kube-system/rama-webhook:webhook-port" -j KUBE-SEP-FYPKJJVT7BDRAATJ
-A KUBE-SEP-FYPKJJVT7BDRAATJ -s 192.168.57.3/32 -m comment --comment "kube-system/rama-webhook:webhook-port" -j KUBE-MARK-MASQ
-A KUBE-SEP-FYPKJJVT7BDRAATJ -p tcp -m comment --comment "kube-system/rama-webhook:webhook-port" -m tcp -j DNAT --to-destination 192.168.57.3:9898
I draw the log from the daemon pod on nodes-1 and find nothing related to iptables settings:
[admin@master-node ~]$ kubectl logs rama-daemon-v5cqj -n kube-system | grep -i fail
E0708 09:14:25.999440 21333 controller.go:361] overlay proxy neigh failed: no matched node or pod ip cache found for ip 192.168.56.1
E0709 11:55:01.865491 21333 controller.go:361] overlay proxy neigh failed: no matched node or pod ip cache found for ip 192.168.56.1
E0709 11:55:33.521743 21333 controller.go:361] overlay proxy neigh failed: no matched node or pod ip cache found for ip 192.168.56.1
E0709 11:56:28.930568 21333 controller.go:361] overlay proxy neigh failed: no matched node or pod ip cache found for ip 192.168.56.1
E0709 11:58:32.546499 21333 controller.go:361] overlay proxy neigh failed: no matched node or pod ip cache found for ip 192.168.56.1
PS: 192.168.56.1
is my gateway of underlay network.
from hybridnet.
Thanks, could you help to grep all error logs? grep E0709
? We believe that iptables module must exit for some reason before executing.
from hybridnet.
We do need an enhancement to adapt to nftables
as what kube-proxy has done.
Pr of kubernetes is kubernetes/kubernetes#82966
Related Kubernetes issue kubernetes/kubernetes#71305
from hybridnet.
Thanks, could you help to grep all error logs?
grep E0709
? We believe that iptables module must exit for some reason before executing.
Of course.
Here are daemons' logs
[admin@master-node ~]$ kubectl logs rama-daemon-v5cqj -n kube-system | grep -i E0709
E0709 11:55:01.865491 21333 controller.go:361] overlay proxy neigh failed: no matched node or pod ip cache found for ip 192.168.56.1
E0709 11:55:33.521743 21333 controller.go:361] overlay proxy neigh failed: no matched node or pod ip cache found for ip 192.168.56.1
E0709 11:56:28.930568 21333 controller.go:361] overlay proxy neigh failed: no matched node or pod ip cache found for ip 192.168.56.1
E0709 11:58:32.546499 21333 controller.go:361] overlay proxy neigh failed: no matched node or pod ip cache found for ip 192.168.56.1
[admin@master-node ~]$ kubectl logs rama-daemon-tvvv6 -n kube-system | grep -i E0709
E0709 00:44:15.681072 17270 controller.go:361] overlay proxy neigh failed: no matched node or pod ip cache found for ip 10.14.100.6
So you can see, no related error found in there.
from hybridnet.
Related Issues (20)
- IPAM controllers get stuck in processing subnet which starts with IP address like 0.X.X.X HOT 1
- Cannot connect to nodeport from inside the cluster while externalTrafficPolicy is Local
- Create 0.1.0.0/22 subnet error
- why not use 4094 but 4096 here HOT 1
- sts pod get stuck in 'ContainerCreating' HOT 1
- Int64 will cause OutOfRange
- Retained IPInstance might be deleted if pod is evicted
- Felix panic because of failing to execute ipset
- hybridnet 在k8s1.26.3中使用异常 HOT 1
- hybridnet容器镜像建议使用类似docker buildx产品一键构建跨CPU架构的镜像,不用一个架构对应一个镜像版本 HOT 1
- Pod name can't be more than 63 characters in length HOT 1
- hostport方式部署的ingress controller无法更新本地iptables规则 HOT 2
- The wrong interfaces in CNI result generated by hybridnet plugin
- Unexpect flooding of unicast vxlan traffic
- Statefulset's pod got stuck in terminating forever after deleting
- Skip IPAM for specific pods HOT 2
- 希望能让一个workload支持配置多个subnet
- 让一个subnet支持多个互不相连的ip
- Changing specified IP of stateful workload will cause multiple IPs being reserved
- Expose subnet statistics as metrics
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hybridnet.