Struct googapis::google::cloud::dataproc::v1::PySparkBatch [−][src]
pub struct PySparkBatch {
pub main_python_file_uri: String,
pub args: Vec<String>,
pub python_file_uris: Vec<String>,
pub jar_file_uris: Vec<String>,
pub file_uris: Vec<String>,
pub archive_uris: Vec<String>,
}
Expand description
A configuration for running an Apache PySpark batch workload.
Fields
main_python_file_uri: String
Required. The HCFS URI of the main Python file to use as the Spark driver. Must be a .py file.
args: Vec<String>
Optional. The arguments to pass to the driver. Do not include arguments
that can be set as batch properties, such as --conf
, since a collision
can occur that causes an incorrect batch submission.
python_file_uris: Vec<String>
Optional. HCFS file URIs of Python files to pass to the PySpark
framework. Supported file types: .py
, .egg
, and .zip
.
jar_file_uris: Vec<String>
Optional. HCFS URIs of jar files to add to the classpath of the Spark driver and tasks.
file_uris: Vec<String>
Optional. HCFS URIs of files to be placed in the working directory of each executor.
archive_uris: Vec<String>
Optional. HCFS URIs of archives to be extracted into the working directory
of each executor. Supported file types:
.jar
, .tar
, .tar.gz
, .tgz
, and .zip
.
Trait Implementations
fn merge_field<B>(
&mut self,
tag: u32,
wire_type: WireType,
buf: &mut B,
ctx: DecodeContext
) -> Result<(), DecodeError> where
B: Buf,
Returns the encoded length of the message without a length delimiter.
Encodes the message to a buffer. Read more
Encodes the message to a newly allocated buffer.
Encodes the message with a length-delimiter to a buffer. Read more
Encodes the message with a length-delimiter to a newly allocated buffer.
Decodes an instance of the message from a buffer. Read more
fn decode_length_delimited<B>(buf: B) -> Result<Self, DecodeError> where
Self: Default,
B: Buf,
fn decode_length_delimited<B>(buf: B) -> Result<Self, DecodeError> where
Self: Default,
B: Buf,
Decodes a length-delimited instance of the message from the buffer.
Decodes an instance of the message from a buffer, and merges it into self
. Read more
Decodes a length-delimited instance of the message from buffer, and
merges it into self
. Read more
This method tests for self
and other
values to be equal, and is used
by ==
. Read more
This method tests for !=
.
Auto Trait Implementations
impl RefUnwindSafe for PySparkBatch
impl Send for PySparkBatch
impl Sync for PySparkBatch
impl Unpin for PySparkBatch
impl UnwindSafe for PySparkBatch
Blanket Implementations
Mutably borrows from an owned value. Read more
Wrap the input message T
in a tonic::Request
pub fn vzip(self) -> V
Attaches the provided Subscriber
to this type, returning a
WithDispatch
wrapper. Read more
Attaches the current default Subscriber
to this type, returning a
WithDispatch
wrapper. Read more