Kubectl get pods doent come up on one particular node

11/14/2019

I have a cluster with two nodes and one master, suddenly one of our node is not taking any pods even though both show as ready when I fire command kubectl get nodes.

#kubectl get node -o wide

server1   Ready     246d      v1.7.6+a08f5eeb62   <none>        Red Hat Enterprise Linux Server 7.7 (Maipo)   3.10.0-1062.1.1.el7.x86_64

server2   Ready     246d      v1.7.6+a08f5eeb62   <none>        Red Hat Enterprise Linux Server 7.6 (Maipo)   3.10.0-957.21.2.el7.x86_64

I have found partial problem but dont know how to fix it, when I fire below command, I get following output

awx-162-vzrw5 4/4 Running 0 1d 10.128.1.215 server1

nginx-1-deploy 0/1 Error 0 16m 10.129.1.149 server2

....

apiVersion: v1

kind: Node

metadata:

  annotations:

    volumes.kubernetes.io/controller-managed-attach-detach: "true"
  creationTimestamp: 2019-03-12T19:53:46Z
  labels:

    app: sysdig-agent
    beta.kubernetes.io/arch: amd64
    beta.kubernetes.io/os: linux
    kubernetes.io/hostname: server
    type: infra
  name: server

  resourceVersion: "31513319"
  selfLink: /api/v1/nodes/server
  uid: 8c57c6fa-4500-11e9-9f0e-0050569d26cf
spec:
  externalID: server

status:

  addresses:

  - address: 11.68.5.165

    type: InternalIP
  - address: server
    type: Hostname

  allocatable:

    cpu: "16"
    memory: 32668456Ki

    pods: "160"
  capacity:

    cpu: "16"
    memory: 32770856Ki

    pods: "160"

  - names:
    - docker.io/ansible/awx_rabbitmq@sha256:3ff448f979149a0684c61b0f00eb0fe7bc480b123323aa80fb3bb8934027f895
    - docker.io/ansible/awx_rabbitmq:3.7.4
    sizeBytes: 85570222
  - names:
    - docker.io/memcached@sha256:1e9858a576c76dc4d34d7f30318f89868127ac3dbf20b472645e8eb8e11cce02
    - docker.io/memcached:latest
    sizeBytes: 82206395

  nodeInfo:

    architecture: amd64

    bootID: 51af6b12-e490-4709-a434-31a04dcf635d

    containerRuntimeVersion: docker://1.13.1

    kernelVersion: 3.10.0-1062.1.1.el7.x86_64

    kubeProxyVersion: v1.7.6+a08f5eeb62

    kubeletVersion: v1.7.6+a08f5eeb62

    machineID: 04fbce323fd847e8bcc3f3d9e8272708

    operatingSystem: linux

    osImage: Red Hat Enterprise Linux Server 7.7 (Maipo)

    systemUUID: 389E1D42-F025-4083-5CB9-24F0743CDFB9
-- Swaroop Kumar
docker
kubectl
kubernetes
nodes
openshift

0 Answers