Wait on GCP Resources¶

Wait on the completion of GCP resources spawned from an upstream pipeline component.

Components:

`WaitGcpResourcesOp`(gcp_resources, ...)	Waits for the completion of one or more GCP resources by polling for completion statuses.

WaitGcpResourcesOp(gcp_resources: str, gcp_resources: dsl.OutputPath(str))

Waits for the completion of one or more GCP resources by polling for completion statuses.

Currently this component only supports waiting on a DataflowJob resource.

To use this component, first create a component that outputs a gcp_resources proto as JSON, then pass it to this component’s gcp_resources parameter.

See details on how to create a gcp_resources proto as a component output.

Examples

Class¶: example

dataflow_python_op = gcpc.v1.dataflow.LaunchPythonOp( python_file_path=… )

dataflow_wait_op = WaitGcpResourcesOp( gcp_resources=dataflow_python_op.outputs[“gcp_resources”] )

Parameters¶

gcp_resources: Serialized JSON of gcp_resources proto, indicating the resource(s) this component should wait on.

Returns¶

``gcp_resources: <class 'str'>``
          The `gcp_resource`, including any relevant error information.