I was trying to access HDFS files from a spark cluster which is running inside Kubernetes containers.
However I keep on getting the error: AnalysisException: 'The ORC data source must be used with Hive support enabled;'
What I am missing here?
Are you have SparkSession created with enableHiveSupport()?
Similar issue: Spark can access Hive table from pyspark but not from spark-submit