Skip to content

Commit be275a7

Browse files
authored
Merge pull request #223 from heywalter/release-4.17.0
docs: add 4.17.0 release documentation
2 parents 73919c9 + 799c667 commit be275a7

9 files changed

Lines changed: 298 additions & 143 deletions

File tree

.github/workflows/spelling.yml

Lines changed: 5 additions & 135 deletions
Original file line numberDiff line numberDiff line change
@@ -1,166 +1,36 @@
11
name: Check Spelling
22

3-
# Comment management is handled through a secondary job, for details see:
4-
# https://github.com/check-spelling/check-spelling/wiki/Feature%3A-Restricted-Permissions
5-
#
6-
# `jobs.comment-push` runs when a push is made to a repository and the `jobs.spelling` job needs to make a comment
7-
# (in odd cases, it might actually run just to collapse a comment, but that's fairly rare)
8-
# it needs `contents: write` in order to add a comment.
9-
#
10-
# `jobs.comment-pr` runs when a pull_request is made to a repository and the `jobs.spelling` job needs to make a comment
11-
# or collapse a comment (in the case where it had previously made a comment and now no longer needs to show a comment)
12-
# it needs `pull-requests: write` in order to manipulate those comments.
13-
14-
# Updating pull request branches is managed via comment handling.
15-
# For details, see: https://github.com/check-spelling/check-spelling/wiki/Feature:-Update-expect-list
16-
#
17-
# These elements work together to make it happen:
18-
#
19-
# `on.issue_comment`
20-
# This event listens to comments by users asking to update the metadata.
21-
#
22-
# `jobs.update`
23-
# This job runs in response to an issue_comment and will push a new commit
24-
# to update the spelling metadata.
25-
#
26-
# `with.experimental_apply_changes_via_bot`
27-
# Tells the action to support and generate messages that enable it
28-
# to make a commit to update the spelling metadata.
29-
#
30-
# `with.ssh_key`
31-
# In order to trigger workflows when the commit is made, you can provide a
32-
# secret (typically, a write-enabled github deploy key).
33-
#
34-
# For background, see: https://github.com/check-spelling/check-spelling/wiki/Feature:-Update-with-deploy-key
35-
36-
# Sarif reporting
37-
#
38-
# Access to Sarif reports is generally restricted (by GitHub) to members of the repository.
39-
#
40-
# Requires enabling `security-events: write`
41-
# and configuring the action with `use_sarif: 1`
42-
#
43-
# For information on the feature, see: https://github.com/check-spelling/check-spelling/wiki/Feature:-Sarif-output
44-
45-
# Minimal workflow structure:
46-
#
47-
# on:
48-
# push:
49-
# ...
50-
# pull_request_target:
51-
# ...
52-
# jobs:
53-
# # you only want the spelling job, all others should be omitted
54-
# spelling:
55-
# # remove `security-events: write` and `use_sarif: 1`
56-
# # remove `experimental_apply_changes_via_bot: 1`
57-
# ... otherwise adjust the `with:` as you wish
3+
# This workflow is intentionally manual-only so spelling does not block pushes
4+
# or pull requests.
585

596
on:
60-
push:
61-
branches:
62-
- "**"
63-
tags-ignore:
64-
- "**"
65-
pull_request_target:
66-
branches:
67-
- "**"
68-
types:
69-
- 'opened'
70-
- 'reopened'
71-
- 'synchronize'
72-
issue_comment:
73-
types:
74-
- 'created'
7+
workflow_dispatch:
758

769
jobs:
7710
spelling:
7811
name: Check Spelling
7912
permissions:
8013
contents: read
81-
pull-requests: read
8214
actions: read
8315
security-events: write
84-
outputs:
85-
followup: ${{ steps.spelling.outputs.followup }}
8616
runs-on: ubuntu-latest
87-
if: ${{ contains(github.event_name, 'pull_request') || github.event_name == 'push' }}
8817
concurrency:
89-
group: spelling-${{ github.event.pull_request.number || github.ref }}
18+
group: spelling-${{ github.ref }}
9019
# note: If you use only_check_changed_files, you do not want cancel-in-progress
9120
cancel-in-progress: true
9221
steps:
9322
- name: check-spelling
9423
id: spelling
9524
uses: check-spelling/check-spelling@main
9625
with:
97-
suppress_push_for_open_pull_request: ${{ github.actor != 'dependabot[bot]' && 1 }}
9826
checkout: true
9927
check_file_names: 0
10028
spell_check_this: check-spelling/spell-check-this@prerelease
10129
post_comment: 0
10230
use_magic_file: 0
10331
report-timing: 1
10432
warnings: bad-regex,binary-file,deprecated-feature,large-file,limited-references,no-newline-at-eof,noisy-file,non-alpha-in-dictionary,token-is-substring,unexpected-line-ending,whitespace-in-dictionary,minified-file,unsupported-configuration,no-files-to-check
105-
experimental_apply_changes_via_bot: 1
106-
use_sarif: ${{ (!github.event.pull_request || (github.event.pull_request.head.repo.full_name == github.repository)) && 1 }}
33+
use_sarif: 1
10734
extra_dictionary_limit: 20
10835
extra_dictionaries:
10936
cspell:software-terms/dict/softwareTerms.txt
110-
111-
comment-push:
112-
name: Report (Push)
113-
# If your workflow isn't running on push, you can remove this job
114-
runs-on: ubuntu-latest
115-
needs: spelling
116-
permissions:
117-
contents: write
118-
if: (success() || failure()) && needs.spelling.outputs.followup && github.event_name == 'push'
119-
steps:
120-
- name: comment
121-
uses: check-spelling/check-spelling@main
122-
with:
123-
checkout: true
124-
spell_check_this: check-spelling/spell-check-this@prerelease
125-
task: ${{ needs.spelling.outputs.followup }}
126-
127-
comment-pr:
128-
name: Report (PR)
129-
# If you workflow isn't running on pull_request*, you can remove this job
130-
runs-on: ubuntu-latest
131-
needs: spelling
132-
permissions:
133-
contents: read
134-
pull-requests: write
135-
if: (success() || failure()) && needs.spelling.outputs.followup && contains(github.event_name, 'pull_request')
136-
steps:
137-
- name: comment
138-
uses: check-spelling/check-spelling@main
139-
with:
140-
checkout: true
141-
spell_check_this: check-spelling/spell-check-this@prerelease
142-
task: ${{ needs.spelling.outputs.followup }}
143-
experimental_apply_changes_via_bot: 1
144-
145-
update:
146-
name: Update PR
147-
permissions:
148-
contents: write
149-
pull-requests: write
150-
actions: read
151-
runs-on: ubuntu-latest
152-
if: ${{
153-
github.event_name == 'issue_comment' &&
154-
github.event.issue.pull_request &&
155-
contains(github.event.comment.body, '@check-spelling-bot apply')
156-
}}
157-
concurrency:
158-
group: spelling-update-${{ github.event.issue.number }}
159-
cancel-in-progress: false
160-
steps:
161-
- name: apply spelling updates
162-
uses: check-spelling/check-spelling@main
163-
with:
164-
experimental_apply_changes_via_bot: 1
165-
checkout: true
166-
ssh_key: "${{ secrets.CHECK_SPELLING }}"

docs/case-practices/best-practice/heart-beat-task.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -5,9 +5,9 @@ TapData uses heartbeat tables to write timestamp information to the source datab
55

66
## Applicable Scenarios
77

8-
* If the source database often has long periods without DML operations (such as data insertion), and you need to quickly determine the status of incremental tasks through the **Incremental Checkpoint** in the **Task List** to ensure the link status and incremental log acquisition are normal.
8+
* If the source database often has long periods without DML operations (such as data insertion), and you need to quickly determine the status of incremental tasks through the **Last Event Time** in the **Task List** to ensure the link status and incremental log acquisition are normal.
99

10-
![Incremental Checkpoint](../../images/incremental_check_point.png)
10+
![Last Event Time](../../images/incremental_check_point.png)
1111

1212
* If the source database has many DML operations, it is necessary to prevent the incremental logs recorded by TapData from being archived and deleted, which would make it impossible to obtain the incremental checkpoint.
1313

docs/connectors/warehouses-and-lake/paimon.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -32,6 +32,7 @@ Add a [Type Modification Processor](../../data-transformation/process-node.md#ty
3232
- To avoid write conflicts and reduce compaction pressure, disable multi-threaded writes in the target node and set batch size to 1,000 rows and timeout to 1,000 ms.
3333
- Always define a primary key for efficient upserts and deletes; for large tables, use partitioning to speed up queries and writes.
3434
- Paimon supports primary keys only (no secondary indexes) and does not allow runtime schema evolution.
35+
- When Paimon is used as the target and soft delete is enabled, TapData converts `DELETE` operations into `UPDATE` operations with a delete marker. Because Paimon updates require complete row data, the source `DELETE` event must provide the full before image; otherwise, fields other than the primary key may be written as `null`. If the source database is MongoDB 6.0 or later, enable **[Document Pre-image](../on-prem-databases/mongodb.md#node-advanced-features)**. For other source databases, ensure that CDC logs contain the complete row data before the `DELETE` operation.
3536

3637
## Connect to Paimon
3738

docs/data-replication/monitor-task.md

Lines changed: 25 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,14 +1,37 @@
11
# Monitor Data Replication Task
22

33

4-
Once the data replication task is started, the page will automatically redirect to the task monitoring page. From there, you can monitor the task's operation details, such as the status of the Agent, data synchronization progress, task progress, alert settings, and other relevant information.
4+
After you start a data replication task, TapData automatically redirects you to the task monitoring page. You can use this page to check runtime details such as Agent status, synchronization status, task progress, and alert settings. You can also review the overall task status from the task list before opening a specific task for details.
5+
56

67
:::tip
78

8-
By clicking the **monitor** button on the task list page, you can access the monitoring page as well.
9+
You can also open the monitoring page by clicking **Monitor** on the task list page.
910

1011
:::
1112

13+
14+
## Task List Metrics
15+
16+
On the **Data Replication** task list page, use filters such as **Task Status**, **Sync Type**, **Task Milestone**, **Agent Name**, and **Task Name** to find tasks. You can also click **Display Settings** to adjust the columns shown in the list. The following table describes the common fields:
17+
18+
| Field | Description |
19+
| --- | --- |
20+
| **Task Name** | The display name of the task. You can search tasks by this field. |
21+
| **Task Status** | The current task status, such as Editing, Running, Stopped, or Failed. |
22+
| **Sync Type** | The task synchronization type, such as full, incremental, or full + incremental. |
23+
| **Task Milestone** | The current execution stage, which helps you determine whether the task is initializing, running full synchronization, running incremental synchronization, or processing another stage. |
24+
| **Incremental Delay** | The time between when an event is generated at the source and when the task finishes processing it. Use this metric to identify incremental backlog. |
25+
| **Last Event Time** | The latest source event time processed by the task. The closer this time is to the current time, the more up to date incremental processing is. |
26+
| **Last Run Time** | The most recent time when the task was started. |
27+
| **Create Time** | The time when the task was created. |
28+
| **Update Time** | The most recent time when the task configuration or status was updated. |
29+
| **Available Operation** | Operations available for the task, such as Start, Edit, Monitor, Reset, Copy, and Delete. The available operations depend on the task status. |
30+
31+
To view node-level metrics, run logs, alerts, or task settings, click **Monitor** on the right side of the target task to open the task details page.
32+
33+
## View Task Details
34+
1235
![](../images/monitor_copy_task_overview.png)
1336

1437

@@ -70,4 +93,3 @@ Click the ![](../images/task_setting_icon.png) icon at the top of the page, whic
7093
* Task increment start notification
7194
* Task stop alert
7295
* Task increment delay alert
73-

0 commit comments

Comments
 (0)