fluentd not work on every kubernetes node

3/13/2018

I am trying to deploye fluentd, elasticsearch & kibana into k8s. I am facing the difficulty to bring fluentd up. I am using the scripts from https://github.com/kubernetes/kubernetes/blob/master/cluster/addons/fluentd-elasticsearch/fluentd-es-ds.yaml, no no custom changes made.

I have one k8s master, and two nodes. After kubectl apply -f yamlfile one node have fluentd pod up, but another fail, with message:

{"log":"2018-03-13 03:45:15 +0000 [error]: unexpected error error_class=Errno::EHOSTUNREACH error=\"Failed to open TCP connection to 10.96.0.1:443 (No route to host - connect(2)     for \\\"10.96.0.1\\\" port 443)\"\n","stream":"stdout","time":"2018-03-13T03:45:15.815733611Z"}

I get this message from /var/log/containers/fluentd_xxx.log I don't know where does this "10.96.0.1:443" come from, and why one

fluentd-es-v2.0.4-9pgcv 1/1 Running 0 19m fluentd-es-v2.0.4-tkxvv 0/1 CrashLoopBackOff 7 19m

any hints would appreciate.

-- user1484819
fluentd
kubernetes

1 Answer

3/13/2018

The problem is caused by the firewall in the failure node. after I stop the firewall, fluentd success. It is a stupid question, but maybe useful for others.

-- user1484819
Source: StackOverflow