Skip to main content

FTP to S3 Migrator

FTP to S3 Migrator is a Nexla utility connector that runs a scheduled migration script to move data files from a folder on an FTP server to an Amazon S3 path. Files are transferred as-is, without triggering Nexla dataset detection by default, making this connector well suited for bulk file migration and archival workflows. Optional settings allow Nexla to scan the migrated files for datasets and to delete the source files from the FTP server after a successful transfer.

Power end-to-end data operations for your FTP to S3 Migrator API with Nexla. Our bi-directional FTP to S3 Migrator connector is purpose-built for FTP to S3 Migrator, making it simple to ingest data, sync it across systems, and deliver it anywhere — all with no coding required. Nexla turns API-sourced data into ready-to-use, reusable data products and makes it easy to send data to FTP to S3 Migrator or any other destination. With comprehensive monitoring, lineage tracking, and access controls, Nexla keeps your FTP to S3 Migrator workflows fast, secure, and fully governed.

Features

Type: API

SourceDestination

  • Seamless API Integration: Connect to any endpoint as source or destination without coding, with automatic data product creation
  • Visual Composition & Chaining: Build complex integrations using visual templates, chain API calls, and compose workflows with data validation and filtering
  • API Proxy: Expose curated slices of your data securely with a secure and customizable API proxy that validates and transforms data on the fly
  • Request optimization with intelligent batching, retry, and caching to minimize API calls and costs

Prerequisites​

The FTP to S3 Migrator is a Nexla-managed utility that connects an existing FTP location to an existing Amazon S3 location—it does not require any credentials of its own. Before configuring this connector, ensure that the following are available in your Nexla account:

  1. An FTP credential — A Nexla credential for the FTP server that contains the files to be migrated. See the FTP connector guide for instructions on creating an FTP credential.

  2. An Amazon S3 credential — A Nexla credential for the S3 account to which the files will be migrated. See the Amazon S3 connector guide for instructions on creating an S3 credential.

  3. Source and destination paths — The path to the FTP folder containing the files to be migrated, and the S3 path to which the files should be written.

This connector migrates files as-is and does not trigger Nexla dataset detection by default. If you want Nexla to scan the migrated files for datasets after they are transferred, enable the Detect Datasets While Migrating Files? setting during source configuration.

Authenticate​

The FTP to S3 Migrator does not use a dedicated credential form. Instead, it authenticates with the FTP server and the S3 account using existing Nexla credentials that are selected during source configuration:

  • FTP Credential — The credential for the FTP server from which data files will be imported.

  • S3 Credential — The credential for the S3 account to which data files will be exported.

If the required FTP or S3 credential does not yet exist in your Nexla account, create it by following the credential instructions in the FTP connector guide or the Amazon S3 connector guide before configuring this connector.

Use as a data source​

To create a new data flow, navigate to the Integrate section, and click the New Data Flow button. Select the FTP to S3 Migrator connector tile, select the S3 credential that will be used for the migration, and click Next; or, create the required credentials for use in this flow.

Endpoint templates​

Nexla provides a pre-built template that configures the FTP-to-S3 migration script. Select the endpoint from the Endpoint pulldown menu, and configure the settings described in the expandable box below.

Transfer files from FTP to S3

This endpoint template moves files from an FTP folder to an S3 path. Use this template to migrate data files on a recurring schedule without modifying their contents.

  • This template runs a Nexla-managed migration script and requires the following settings:

    • Script Execution Frequency — How often the migration script should run.
    • FTP Credential — The credential for the FTP server from which data will be imported.
    • FTP Folder path — The path to the FTP folder containing the files to be migrated. The default value is /.
    • Delete FTP files after export? — Select Yes to delete the files from the FTP server after they are migrated. The default value is No.
    • Detect Datasets While Migrating Files? — Select Yes to have Nexla scan the files for datasets after migrating the data. The default value is No.
    • S3 Credential — The credential for the S3 account to which data will be exported.
    • S3 Path — The S3 path to which the migrated files will be written.

Files are transferred as-is from the FTP folder to the S3 path on the configured schedule. Unless the Detect Datasets While Migrating Files? setting is enabled, the migrated files are not scanned for datasets, and no Nexsets are generated from their contents.

Once the endpoint template has been configured, click the Create button in the upper right corner of the screen to save and create the new FTP to S3 Migrator data source. Nexla will now run the migration script at the configured frequency, moving files from the specified FTP folder to the specified S3 path.