Hi I wanted to verify that SegmentCount=N creates 150 routines.
scanner := ddb.NewScanner(ddb.Config{
TableName: "ddb-table-name",
TotalSegments: 150, // calculate value: (table size GB / 2GB)
SegmentOffset: 0, // optional param for controlling offset
SegmentCount: 150, // optional param for controlling how many routines get created
})
I used the following AWS CLI command trying to utilize the parallel scan function but didn't realize that it would only return the results of the 1 partition.
aws dynamodb scan --table-name LargeTable --region us-east-1 --total-segments 150 --segment 0 --query "Items[*].[category1.N,category2.N,category3.N]" --output text
Does scanner go through all of the partitions?
Thank you!
Hi I wanted to verify that SegmentCount=N creates 150 routines.
I used the following AWS CLI command trying to utilize the parallel scan function but didn't realize that it would only return the results of the 1 partition.
aws dynamodb scan --table-name LargeTable --region us-east-1 --total-segments 150 --segment 0 --query "Items[*].[category1.N,category2.N,category3.N]" --output textDoes scanner go through all of the partitions?
Thank you!