Azure Data Factory

Azure Data Factory is a managed cloud service designed for hybrid Extract-Transform-Load (ETL), Extract-Load-Transform (ELT), data integration and data transformation projects.

ActiveBatch now supports the Azure Data Factory!

The Azure Data Factory extension allows users to orchestrate and automate Azure Data Pipeline jobs on both Windows and non-Windows agents.

 

 

Login

 

 

Sets authenticated session for subsequent job steps.

 

Job Step Properties

 

Connection: Connection is optional for all Job Steps except Login. Select Connection Data from the drop-down menu and enter a User Account and

Region.

 

List Pipelines

 

 

Lists all the pipelines in the factory.

 

Job Step Properties

 

Connection: If not specified by the Login Job Step, this field is required. Select Connection Data from the drop-down menu and enter a User Account and

Region.

 

 

Synchronize Pipeline Run

 

Wait for a Pipeline Run to complete before continuing.

 

Connection: If not specified by the Login Job Step, this field is required. Select Connection Data from the drop-down menu and enter a User Account and

Region.

 

Run Pipeline:

Begins the run of the pipeline.

 

Connection: If not specified by the Login Job Step, this field is required. Select Connection Data from the drop-down menu and enter a User Account and

Region.

 

Reference Pipeline Run ID: This is the pipeline run identifier. If the run ID is specified, the parameters of the specified run will be used to create a new run.

 

Is Recovery: This is the recovery mode flag. If recovery mode is set to True, the specified pipeline run and the new run will be grouped under the same Group ID.

 

Start Activity Name: In recovery mode, this will rerun will start from this activity. If not specified, all activities will run.

 

Start From Failure: In recovery mode, if set to True, the rerun will start from failed activities. This property will only be used if "startActivityName" is not specified.

 

Parameters: The parameters of the pipeline run. These parameters will only be used if the run_id is not specified.

 

Wait for Completion: Wait for the pipeline to complete before completing the job step.

 

Get Pipeline Run

 

Get a pipeline run by the run identifier.

 

Run ID Specify the pipeline run identifier.

 

Cancel Pipeline Run

 

Cancel a pipeline run by it's run identifier.

 

Run ID Specify the pipeline run identifier.

Is Recursive If True, cancel all the pipelines which were triggered by the current pipeline.