| Name | Type | Description | |
|---|---|---|---|
| Output Stream Name | String | The name of the stream you would like this source to output. Can contain letters, numbers, or underscores. | |
| Pattern of files to replicate | String | A regular expression which tells the connector which files to replicate. All files which match this pattern will be replicated. Use | to separate multiple patterns. See this page to understand pattern syntax (GLOBSTAR and SPLIT flags are enabled). Use pattern ** to pick up all files. |
| File Format | Object | The format of the files you'd like to replicate | |
| Manually enforced data schema (Optional) | String | Optionally provide a schema to enforce, as a valid JSON string. Ensure this is a mapping of { "column" : "type" }, where types are valid JSON Schema datatypes. Leave as {} to auto-infer the schema. | |
| S3: Amazon Web Services | Object | Use this to load files from S3 or S3-compatible services |
