Sftp bulk
Prerequisites
- The Server with FTP connection type support
- The Server host
- The Server port
- Username-Password/Public Key Access Rights
Setting up the Sftp bulk connector
| No | Item | Required | Example | Notes |
|---|---|---|---|---|
| 1 | User Name | Yes | The server user | |
| 2 | Password | No | OS-level password for logging into the jump server host | |
| 3 | Private key | No | The private key | |
| 4 | Host Address | Yes | www.host.com 192.0.2.1 | The server host address |
| 5 | Port | Yes | 22 | The server port |
| 6 | Stream name | Yes | ftp_contacts | The name of the stream or table you want to create |
| 7 | File type | No | csv json | The file type you want to sync. Currently only 'csv' and 'json' files are supported. |
| 8 | Folder Path (Optional) | Yes | /logs/2022 | The directory to search files for sync |
| 9 | File Pattern (Optional) | No | log-([0-9]{4})([0-9]{2})([0-9]{2}) - This will filter files which log-yearmmdd | The regular expression to specify files for sync in a chosen Folder Path |
| 10 | Most recent file (Optional) | No | Sync only the most recent file for the configured folder path and file pattern | |
| 11 | Start Date | Yes | 2017-01-25T00:00:00Z | The date from which you'd like to replicate data for all incremental streams, in the format YYYY-MM-DDT00:00:00Z. All data generated after this date will be replicated. |
Zipstack Cloud features a powerful SQL querying engine on top of many types of connectors, including those from Trino, some custom connectors and connectors from the open source Airbyte project. Some Zipstack cloud connectors are designed to utilize and expand upon Airbyte's connector protocol, but they do not use Airbyte's EL core. Additionally, some parts of the documentation for these connectors have been adapted from the connector documentation found in Airbyte's open source project.