External Source
This Shovel Operation will source a file from an external source.
Note
This widget is now used in replacement of the previous "SFTP Source" widget.
Widget
Configuration
Configuration depends on the specific type of external source, as identified by the connection-id field.
Fill in the following fields:
Description: Allows changing the name that appears on the widget. This may be useful to quickly find a particular widget or distinguishing it from other similar shovel operation widgets when building large flows.
Shovel Operation: The name of the Shovel Operation. Pre-configured to ExternalSource.
id: ID for this Shovel Operation. Needs to be unique within an integration in the format of a UUID. An online generator may be used to produce the ID. This is an arbitrary String value. (E.g., 9538e014-2f3a-4b7e-b9de-09eb37565e77)
connectionId: Unique identifier of the specific connection to source documents from. The ID of the connection that was created in the Connections step (See Section : “Adding a Connection”).
directory: The specific directory to obtain files from. SFTP folder.
pollingInterval: The interval in seconds to request files expressed as an integer.
filenameConvention: A Regular Expression used to match against files in the specified directory as a filter before downloading. i.e: ^.+.x12$. this file will be used to determine what file from the SFTP folder we will be pulling. The information for the file name convention can be found in the implementation documents. (E.g., 834_YYMMDDSS.X12)
deleteAfterDownload: Boolean. If true, the file will be deleted from the external source once successfully downloaded.
If necessary, click the Notes tab and enter any relevant information.
Click Save.
The widget will be marked with a green check.
