Creating a CAAS using Kubernetes/Docker/Flannel/etcd

9/18/2015

I would like to request some expert opinion from SMEs on:

  1. What would it take to build a CAAS using physical/bare-metal servers.

    a) Suggested options to implement concerns like : Resource Monitoring, Utilization etc

    b) Any suggested approaches to make a robust, scalable, resilient underlying infrastructure which marries well kubernetes/docker/etcd/flannel based CAAS layer

enter image description here

  1. Kubernetes as a solution likes to leverage underlying "Cloud Provider" ; any suggestion to create it from scratch? (of course I am not looking at elaborate solutions like OpenStack, since the idea is to create a lean/low-cost/light-weight solution) The solution I am looking for is to create an IAAS out of lets say 10 prod servers. Not looking for Data Center type of solutions.
-- Suyog Barve
docker
kubernetes
openshift

2 Answers

2/7/2019

i have implemented similar setup on baremetal.

  1. you dont need etcd on each machine
  2. setup 3 node etcd cluster for high availability
  3. if you have space machines then keep etcd cluster separated from controle plane
  4. setup 3 node control plane
  5. use nginx for load balancing the masters/control plane
  6. Run keepalived service on each control plane.
  7. The virtual ip should be routable in the across the nodes in cluster. chose VIP from same subnet
  8. keepalived provide failover in case primary control plance/master is down
-- P Ekambaram
Source: StackOverflow

9/18/2015

For your second question, you should check out the Getting started from Scratch guide in the Kubernetes docs.

-- Robert Bailey
Source: StackOverflow