Spark-on-k8s-operator: Does MainApplicationFile supports use of a remote url for the spark application file? What other formats are supported?

Created on 18 Dec 2018  路  2Comments  路  Source: GoogleCloudPlatform/spark-on-k8s-operator

question

Most helpful comment

Yes, it supports http://, hdfs://, s3a://, gcs://, and any URLs of some remote storage compatible with the Hadoop file system API.

All 2 comments

Yes, it supports http://, hdfs://, s3a://, gcs://, and any URLs of some remote storage compatible with the Hadoop file system API.

Closing. Feel free to reopen if you have more questions.

Was this page helpful?
0 / 5 - 0 ratings