Multi-Node Hadoop in kubernetes

5/22/2017

I already intalled minikube the single node Kubernetes cluster, I just want a help of how to deploy a multi-node hadoop cluster inside this kubernetes node, I need a starting point please!?

-- Hassan Shaitou
docker
hadoop
kubernetes
minikube

1 Answer

5/22/2017

For clarification, do you want hadoop to leverage k8s components to run jobs or do you just want it to run as a k8s pod?

Unfortunately I could not find an example of hadoop built as a Kubernetes scheduler. You can probably still run it similar to the spark example.

Update: Spark now ships with better integration for Kubernetes. Information can be found here here

-- cmluciano
Source: StackOverflow