File Move Action

Plugin version: 2.11.0

Moves a file or files.

This action can be used when a file or files need to be moved to a new location in a file system, often required when archiving files. The source and destination must be on the same file system.

Configuration

Property

Macro Enabled?

Description

Property

Macro Enabled?

Description

Source Path

Yes

Required. The full path of the file or directory that is to be moved. In the case of a directory, if fileRegex is set, then only files in the source directory matching the wildcard regex will be moved. Otherwise, all files in the directory will be moved. For example: hdfs://hostname/tmp.

Destination Path

Yes

Required. The valid, full destination path in the same cluster where the file or files are to be moved. If a directory is specified with a file sourcePath, the file will be put into that directory. If sourcePath is a directory, it is assumed that destPath is also a directory.

Wildcard

Yes

Optional. Wildcard regular expression to filter the files in the source directory that will be moved.

Continue Pipeline Upon Error

No

Required.  Indicates if the pipeline should continue if the move process fails. If all files are not successfully moved, the action will not return the files already moved to their original locations.

Default is false.

Example

This example moves a file from /source/path to /dest/path:

Property

Value

Property

Value

Source Path

hdfs://example.com:8020/source/path

Destination Path

hdfs://example.com:8020/dest/path

Wildcard

.*\.txt

Continue Pipeline Upon Error

false

 

Created in 2020 by Google Inc.