K
Q

Helm - Spark operator examples/spark-pi.yaml does not exist

2/20/2020

I've deployed Spark Operator to GKE using the Helm Chart to a custom namespace:

helm install --name sparkoperator incubator/sparkoperator --namespace custom-ns --set sparkJobNamespace=custom-ns

and confirmed the operator running in the cluster with helm status sparkoperator.

However when I'm trying to run the Spark Pi example kubectl apply -f examples/spark-pi.yaml I'm getting the following error:

the path "examples/spark-pi.yaml" does not exist

There are few things that I probably still don't get:

  1. Where is actually examples/spark-pi.yaml located after deploying the operator?
  2. What else should I check and what other steps should I take to make the example work?
-- samba
apache-spark
google-cloud-platform
google-kubernetes-engine
kubernetes
kubernetes-helm

Similar Questions

How to send CURL request for Nginx Ingress authentication?
Gitlab runner fail to use cache with minio
cluster doesn't have a stable controlPlaneEndpoint address
etcd replication in a kubernetes architecture

2 Answers

2/20/2020

Please find the spark-pi.yaml file here.

You should copy it to your filesystem, customize it if needed, and provide a valid path to it with kubectl apply -f path/to/spark-pi.yaml.

-- Aliaksandr Sasnouskikh
Source: StackOverflow
2/20/2020

kubectl apply needs a yaml file either locally on the system where you are running kubectl command or it can be a http/https endpoint hosting the file.

-- Arghya Sadhu
Source: StackOverflow