Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions examples/yaml/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -27,10 +27,10 @@ A suite of YAML pipeline examples is currently located under the directory
These examples leverage the built-in `Combine` transform for performing simple
aggregations including sum, mean, count, etc.

### [Blueprints](../../sdks/python/apache_beam/yaml/examples/transforms/blueprint)
### [Pipelines](../../sdks/python/apache_beam/yaml/examples/transforms/pipelines)

These examples leverage DF or other existing templates and convert them to yaml
blueprints.
pipelines.

### [Element-wise](../../sdks/python/apache_beam/yaml/examples/transforms/elementwise)

Expand Down
13 changes: 7 additions & 6 deletions sdks/python/apache_beam/yaml/examples/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,11 +25,11 @@
* [Wordcount](#wordcount)
* [Transforms](#transforms)
* [Aggregation](#aggregation)
* [Blueprints](#blueprints)
* [Element-wise](#element-wise)
* [IO](#io)
* [Jinja](#jinja)
* [ML](#ml)
* [Pipelines](#pipelines)

<!-- TOC -->

Expand Down Expand Up @@ -89,11 +89,6 @@ YAML framework.
These examples leverage the built-in `Combine` transform for performing simple
aggregations including sum, mean, count, etc.

### Blueprints

These examples leverage DF or other existing templates and convert them to yaml
blueprints.

### Element-wise

These examples leverage the built-in mapping transforms including `MapToFields`,
Expand Down Expand Up @@ -277,3 +272,9 @@ Examples that include ML-specific transforms such as `RunInference` and

More information can be found about aggregation transforms
[here](https://beam.apache.org/documentation/sdks/yaml-combine/).


### Pipelines

These examples leverage DF or other existing templates and convert them to yaml
pipelines.
Original file line number Diff line number Diff line change
Expand Up @@ -1381,9 +1381,6 @@ def _jinja_preprocessor(raw_spec_string: str, test_name: str):
AggregationTest = YamlExamplesTestSuite(
'AggregationExamplesTest',
os.path.join(YAML_DOCS_DIR, '../transforms/aggregation/*.yaml')).run()
BlueprintTest = YamlExamplesTestSuite(
'BlueprintExamplesTest',
os.path.join(YAML_DOCS_DIR, '../transforms/blueprint/*.yaml')).run()
ElementWiseTest = YamlExamplesTestSuite(
'ElementwiseExamplesTest',
os.path.join(YAML_DOCS_DIR, '../transforms/elementwise/*.yaml')).run()
Expand All @@ -1398,6 +1395,9 @@ def _jinja_preprocessor(raw_spec_string: str, test_name: str):
MLTest = YamlExamplesTestSuite(
'MLExamplesTest', os.path.join(YAML_DOCS_DIR,
'../transforms/ml/**/*.yaml')).run()
PipelinesTest = YamlExamplesTestSuite(
'PipelinesExamplesTest',
os.path.join(YAML_DOCS_DIR, '../transforms/pipelines/*.yaml')).run()

if __name__ == '__main__':
logging.getLogger().setLevel(logging.INFO)
Expand Down
Loading