Struct google_api_proto::google::cloud::bigquery::v2::SparkStatistics

pub struct SparkStatistics {
    pub spark_job_id: Option<String>,
    pub spark_job_location: Option<String>,
    pub endpoints: BTreeMap<String, String>,
    pub logging_info: Option<LoggingInfo>,
    pub kms_key_name: Option<String>,
    pub gcs_staging_bucket: Option<String>,
}

Statistics for a BigSpark query. Populated as part of JobStatistics2

Fields

spark_job_id: Option<String>

Output only. Spark job ID if a Spark job is created successfully.

spark_job_location: Option<String>

Output only. Location where the Spark job is executed. A location is selected by BigQueury for jobs configured to run in a multi-region.

endpoints: BTreeMap<String, String>

Output only. Endpoints returned from Dataproc. Key list:

• history_server_endpoint: A link to Spark job UI.

logging_info: Option<LoggingInfo>

Output only. Logging info is used to generate a link to Cloud Logging.

kms_key_name: Option<String>

Output only. The Cloud KMS encryption key that is used to protect the resources created by the Spark job. If the Spark procedure uses the invoker security mode, the Cloud KMS encryption key is either inferred from the provided system variable, @@spark_proc_properties.kms_key_name, or the default key of the BigQuery job’s project (if the CMEK organization policy is enforced). Otherwise, the Cloud KMS key is either inferred from the Spark connection associated with the procedure (if it is provided), or from the default key of the Spark connection’s project if the CMEK organization policy is enforced.

Example:

• projects/\[kms_project_id\]/locations/\[region\]/keyRings/\[key_region\]/cryptoKeys/\[key\]

gcs_staging_bucket: Option<String>

Output only. The Google Cloud Storage bucket that is used as the default file system by the Spark application. This field is only filled when the Spark procedure uses the invoker security mode. The gcsStagingBucket bucket is inferred from the @@spark_proc_properties.staging_bucket system variable (if it is provided). Otherwise, BigQuery creates a default staging bucket for the job and returns the bucket name in this field.

Example:

• gs://\[bucket_name\]

Implementations

impl SparkStatistics

pub fn spark_job_id(&self) -> &str

Returns the value of spark_job_id, or the default value if spark_job_id is unset.

pub fn spark_job_location(&self) -> &str

Returns the value of spark_job_location, or the default value if spark_job_location is unset.

pub fn kms_key_name(&self) -> &str

Returns the value of kms_key_name, or the default value if kms_key_name is unset.

pub fn gcs_staging_bucket(&self) -> &str

Returns the value of gcs_staging_bucket, or the default value if gcs_staging_bucket is unset.

Trait Implementations

impl Clone for SparkStatistics

fn clone(&self) -> SparkStatistics

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SparkStatistics

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SparkStatistics

fn default() -> Self

Returns the “default value” for a type.

impl Message for SparkStatistics

fn encoded_len(&self) -> usize

Returns the encoded length of the message without a length delimiter.

fn clear(&mut self)

Clears the message, resetting all fields to their default.

fn encode(&self, buf: &mut impl BufMut) -> Result<(), EncodeError>

where Self: Sized,

Encodes the message to a buffer.

fn encode_to_vec(&self) -> Vec<u8>

where Self: Sized,

Encodes the message to a newly allocated buffer.

fn encode_length_delimited( &self, buf: &mut impl BufMut, ) -> Result<(), EncodeError>

where Self: Sized,

Encodes the message with a length-delimiter to a buffer.

fn encode_length_delimited_to_vec(&self) -> Vec<u8>

where Self: Sized,

Encodes the message with a length-delimiter to a newly allocated buffer.

fn decode(buf: impl Buf) -> Result<Self, DecodeError>

where Self: Default,

Decodes an instance of the message from a buffer.

fn decode_length_delimited(buf: impl Buf) -> Result<Self, DecodeError>

where Self: Default,

Decodes a length-delimited instance of the message from the buffer.

fn merge(&mut self, buf: impl Buf) -> Result<(), DecodeError>

where Self: Sized,

Decodes an instance of the message from a buffer, and merges it into self.

fn merge_length_delimited(&mut self, buf: impl Buf) -> Result<(), DecodeError>

where Self: Sized,

Decodes a length-delimited instance of the message from buffer, and merges it into self.

impl PartialEq for SparkStatistics

fn eq(&self, other: &SparkStatistics) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

This method tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for SparkStatistics