ADLS Delete Action

Plugin version: 0.15.0

ADLS delete action deletes a file or files within ADLS file system.

Configuration

Property

Macro Enabled?

Description

Property

Macro Enabled?

Description

File system uri

Yes

Required. ADLS file system uri. For example, adl://adks.azuredatalakestore.net/test.

Refresh Token URL

Yes

Required. Refresh URL to access Microsoft Azure Data Store. For example, https://login.windows.net/5f3d9a6a-aaaa-aaaa-aaaa-aaaaaaaaaaaa/oauth2/token.

Client Id

Yes

Required. Microsoft Azure client ID, which is typically the Application ID. For example, 1016c0cb-aaaa-aaaa-aaaa-aaaaaaaaaaaa.

Credentials

Yes

Required. Key to access Microsoft Azure Data Store.

Path to desired file(s) to be removed

Yes

Required. The full ADLS path of the file or files that need to be deleted. If the path points to a file, the file will be removed. If the path points to a directory with no regex specified, the directory and all of its contents will be removed. If a regex is specified, only the files and directories matching that regex will be removed. For example, f1cF7CwFJKlMWXPzAAAA1XB7BErAAAAAAAAAAAAAAAA=.

Wildcard

Yes

Optional. Wildcard regular expression to filter the files in the source directory that will be removed. For example, .*\.csv.

Continue Pipeline Upon Error

No

Required. Indicates if the pipeline should continue if the delete process fails. If all files are not successfully deleted, the action will not re-create the files already deleted.

Default is false.

Example

This example deletes all files ending in .csv from /dirToDelete:

Property

Value

Property

Value

File system uri

adl://adks.azuredatalakestore.net/test

Refresh Token URL

https://login.windows.net/5f3d9a6a-aaaa-aaaa-aaaa-aaaaaaaaaaaa/oauth2/token

Client Id

1016c0cb-aaaa-aaaa-aaaa-aaaaaaaaaaaa

Credentials

f1cF7CwFJKlMWXPzAAAA1XB7BErAAAAAAAAAAAAAAAA=

Path to desired file(s) to be removed

dirToDelete/

Wildcard

.*\.csv

Continue Pipeline Upon Error

false

 

Created in 2020 by Google Inc.