| Name | Type | Description |
|---|---|---|
| Project ID | String | The GCP project ID for the project containing the target BigQuery dataset. Read more here. |
| Default Dataset ID | String | The default BigQuery Dataset ID that tables are replicated to if the source does not specify a namespace. Read more here. |
| Loading Method * | Object | Loading method used to send select the way data will be uploaded to BigQuery. Standard Inserts - Direct uploading using SQL INSERT statements. This method is extremely inefficient and provided only for quick testing. In almost all cases, you should use staging. GCS Staging - Writes large batches of records to a file, uploads the file to GCS, then uses COPY INTO table to upload the file. Recommended for most workloads for better speed and scalability. Read more about GCS Staging here. |
| Service Account Key JSON (Required for cloud, optional for open-source) | String | The contents of the JSON service account key. Check out the docs if you need help generating this key. Default credentials will be used if this field is left empty. |
| Dataset Location (Optional) | String | The location of the dataset. Warning: Changes made after creation will not be applied. The default "US" value is used if not set explicitly. Read more here. |
| Google BigQuery Client Chunk Size (Optional) | Integer | Google BigQuery client's chunk (buffer) size (MIN=1, MAX = 15) for each table. The size that will be written by a single RPC. Written data will be buffered and only flushed upon reaching this size or closing the channel. The default 15MB value is used if not set explicitly. Read more here. |
