How can I access HDP cluster from kubernetes pod

9/19/2018

I am using micro-service to access hadoop and hbase to get data but it's not accessible from pod.

It shows only:

INFO ipc.Client: Retrying connect to server: hdpcluster.internal/10.160.0.2:8020. Already tried 3 time(s); maxRetries=45

IP 10.160.0.2 is accessible from all nodes and they are on GCP.

-- Keshav Kumar
docker
google-cloud-platform
google-kubernetes-engine
kubernetes
kubernetes-helm

1 Answer

9/21/2018

You probably need to open a firewall rule to allow port 8020 on your Hbase nodes that your Kubernetes nodes can connect to them. Something like this on your Hbase firewall rules (for your Hbase nodes):

Sample firewall

-- Rico
Source: StackOverflow