diff --git a/docs/api-reference/loaders-storage-targets/bigquery-loader/configuration-reference/_common_config.md b/docs/api-reference/loaders-storage-targets/bigquery-loader/configuration-reference/_common_config.md index 1c4c84f83..fc03f5ebb 100644 --- a/docs/api-reference/loaders-storage-targets/bigquery-loader/configuration-reference/_common_config.md +++ b/docs/api-reference/loaders-storage-targets/bigquery-loader/configuration-reference/_common_config.md @@ -51,6 +51,20 @@ import Link from '@docusaurus/Link';
retries.transientErrors.attemptsretries.alterTableWait.delayOptional. Default value 1 second.
Configures backoff when waiting for the BigQuery Writer to detect that the loader has altered the table by adding new columns.
+retries.tooManyColumns.delayOptional. Default value 300 seconds.
Relevant when the BigQuery table is close to exceeding the limit on max allowed columns in a single table. The loader will ignore a failure to alter the table due to too many columns, and it will continue to run. Some events will inevitably go to the failed events output topic until new columns have been added. This parameter configures how often the loader will retry to alter the table after an earlier failure.
+skipSchemasmonitoring.webhook.heartbeat.*5.minutes. How often to send a heartbeat event to the webhook when healthy.monitoring.healthProbe.port8000. Open a HTTP server that returns OK only if the app is healthy.monitoring.healthProbe.unhealthyLatency5 minutes. Health probe becomes unhealthy if any received event is still not fully processed before this cutoff time.monitoring.sentry.dsninput.subscriptionprojects/myproject/subscriptions/snowplow-enriched. Name of the Pub/Sub subscription with the enriched eventsinput.durationPerAckExtension15 seconds. Pub/Sub ack deadlines are extended for this duration when needed.1.5 seconds left of the remaining deadline, before re-extending the message deadline.
input.maxMessagesPerPullinput.debounceRequests100 millis.
- Adds an artifical delay between consecutive requests to Pub/Sub for more messages.
- Under some circumstances, this was found to slightly alleviate a problem in which Pub/Sub might re-deliver the same messages multiple times.
- input.retries.transientErrors.delay (since 2.1.0)