K
Q

Azure Kubernetes Cluster Node Failure Scenario

8/17/2018

Let's say I have 3 nodes in my cluster and I want to run 300 jobs.

If I run 1 job per POD and 100 pods per NODE, what will happen if a node fails in Azure Kubernetes Service?

-- Talha Irfan
azure
azure-kubernetes
kubernetes

Similar Questions

Deploying DB2 Warehouse to IBM Cloud with Kubernetes
How to share volume of my google cloud instance with the kubernetes cluster
minikube start error getting Pods with label selector "k8s-app=kube-proxy" on win10
Accessing project specific resources in other projects in Google Kubernetes Engine
How to solve unknown shorthand flag: 'R' error with CP command
How to let Kubernetes pod run a local script
DNS for kubernetes pods and airflow worker logs
node joined successfully to master node, but got error when kubectl get nodes "The connection to the server localhost:8080 was refused"
Why minikube runs as a container itself?
how can i set kubectl scale deployment into deployment file?

2 Answers

8/30/2018

if a node fails

Cluster Autoscaler (CA) can be used to handle node failures in Azure using autoscaling groups:

https://github.com/kubernetes/autoscaler/blob/master/cluster-autoscaler/cloudprovider/azure/README.md

https://docs.microsoft.com/en-us/azure/aks/autoscaler

https://docs.microsoft.com/en-us/azure/aks/scale-cluster

-- Vikram Hosakote
Source: StackOverflow
8/30/2018

Those Jobs will go to pending, as Kubernetes supports 110 pods per node, so wouldn't have the resources to support the failed over jobs. You could look at using the Cluster Autoscaler (Beta) and it would provision more host to satisfy running those jobs that are in a pending state.

-- Strebel - MSFT
Source: StackOverflow