| Name | Type | Description |
|---|---|---|
| Project ID | String | The GCP project ID for the project containing the target BigQuery dataset. Read more here. |
| Dataset Location | String | The location of the dataset. Warning: Changes made after creation will not be applied. Read more here. |
| Default Dataset ID | String | The default BigQuery Dataset ID that tables are replicated to if the source does not specify a namespace. Read more here. |
| Loading Method | Object | Loading method used to send select the way data will be uploaded to BigQuery. Standard Inserts - Direct uploading using SQL INSERT statements. This method is extremely inefficient and provided only for quick testing. In almost all cases, you should use staging. GCS Staging - Writes large batches of records to a file, uploads the file to GCS, then uses COPY INTO table to upload the file. Recommended for most workloads for better speed and scalability. Read more about GCS Staging here. |
| Service Account Key JSON (Required for cloud, optional for open-source) | String | The contents of the JSON service account key. Check out the docs if you need help generating this key. Default credentials will be used if this field is left empty. |
| Transformation Query Run Type (Optional) | String | Interactive run type means that the query is executed as soon as possible, and these queries count towards concurrent rate limit and daily limit. Read more about interactive run type here. Batch queries are queued and started as soon as idle resources are available in the BigQuery shared resource pool, which usually occurs within a few minutes. Batch queries don’t count towards your concurrent rate limit. Read more about batch queries here. The default "interactive" value is used if not set explicitly. |
| Google BigQuery Client Chunk Size (Optional) | Integer | Google BigQuery client's chunk (buffer) size (MIN=1, MAX = 15) for each table. The size that will be written by a single RPC. Written data will be buffered and only flushed upon reaching this size or closing the channel. The default 15MB value is used if not set explicitly. Read more here. |
