Struct google_api_proto::google::cloud::bigquery::v2::SparkOptions

pub struct SparkOptions {
    pub connection: String,
    pub runtime_version: String,
    pub container_image: String,
    pub properties: BTreeMap<String, String>,
    pub main_file_uri: String,
    pub py_file_uris: Vec<String>,
    pub jar_uris: Vec<String>,
    pub file_uris: Vec<String>,
    pub archive_uris: Vec<String>,
    pub main_class: String,
}

Options for a user-defined Spark routine.

Fields

connection: String

Fully qualified name of the user-provided Spark connection object. Format: "projects/{project_id}/locations/{location_id}/connections/{connection_id}"

runtime_version: String

Runtime version. If not specified, the default runtime version is used.

container_image: String

Custom container image for the runtime environment.

properties: BTreeMap<String, String>

Configuration properties as a set of key/value pairs, which will be passed on to the Spark application. For more information, see Apache Spark and the procedure option list.

main_file_uri: String

The main file/jar URI of the Spark application. Exactly one of the definition_body field and the main_file_uri field must be set for Python. Exactly one of main_class and main_file_uri field should be set for Java/Scala language type.

py_file_uris: Vec<String>

Python files to be placed on the PYTHONPATH for PySpark application. Supported file types: .py, .egg, and .zip. For more information about Apache Spark, see Apache Spark.

jar_uris: Vec<String>

JARs to include on the driver and executor CLASSPATH. For more information about Apache Spark, see Apache Spark.

file_uris: Vec<String>

Files to be placed in the working directory of each executor. For more information about Apache Spark, see Apache Spark.

archive_uris: Vec<String>

Archive files to be extracted into the working directory of each executor. For more information about Apache Spark, see Apache Spark.

main_class: String

The fully qualified name of a class in jar_uris, for example, com.example.wordcount. Exactly one of main_class and main_jar_uri field should be set for Java/Scala language type.

Trait Implementations

impl Clone for SparkOptions

fn clone(&self) -> SparkOptions

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SparkOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SparkOptions

fn default() -> Self

Returns the “default value” for a type.

impl Message for SparkOptions

fn encoded_len(&self) -> usize

Returns the encoded length of the message without a length delimiter.

fn clear(&mut self)

Clears the message, resetting all fields to their default.

fn encode(&self, buf: &mut impl BufMut) -> Result<(), EncodeError>

where Self: Sized,

Encodes the message to a buffer.

fn encode_to_vec(&self) -> Vec<u8>

where Self: Sized,

Encodes the message to a newly allocated buffer.

fn encode_length_delimited( &self, buf: &mut impl BufMut, ) -> Result<(), EncodeError>

where Self: Sized,

Encodes the message with a length-delimiter to a buffer.

fn encode_length_delimited_to_vec(&self) -> Vec<u8>

where Self: Sized,

Encodes the message with a length-delimiter to a newly allocated buffer.

fn decode(buf: impl Buf) -> Result<Self, DecodeError>

where Self: Default,

Decodes an instance of the message from a buffer.

fn decode_length_delimited(buf: impl Buf) -> Result<Self, DecodeError>

where Self: Default,

Decodes a length-delimited instance of the message from the buffer.

fn merge(&mut self, buf: impl Buf) -> Result<(), DecodeError>

where Self: Sized,

Decodes an instance of the message from a buffer, and merges it into self.

fn merge_length_delimited(&mut self, buf: impl Buf) -> Result<(), DecodeError>

where Self: Sized,

Decodes a length-delimited instance of the message from buffer, and merges it into self.

impl PartialEq for SparkOptions

fn eq(&self, other: &SparkOptions) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

This method tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for SparkOptions